My fantastic Webdings Logo

Elisa Drelie Gelasca

Vision Research Lab.


Research

 
BioImage Analysis
Biological images are critical components for a detailed understanding of the structure and functioning of cells and proteins. Image processing and analysis tools increasingly play a significant role in better harvesting this vast amount of data, most of which is currently analyzed manually and qualitatively. A number of image analysis tools have been proposed to automatically extract the image information. As the studies relying on image analysis tools have become widespread, the validation of these methods, in particular, segmentation methods, has become more critical. There have been very few efforts at creating benchmark datasets in the context of subcellular, cell and tissue imaging [read more]

Related Papers:

You can find all details concerning the method in the following papers:

 

  • Elisa Drelie Gelasca, Jiyun Byun, Boguslaw Obara, B.S. Manjunath,
    " Evaluation and Benchmark for Biological Image Segmentation "
    Proc. IEEE International Conference on Image Processing, San Diego, CA, Oct. 2008.

    Abstract preview: "This paper describes ongoing work on creating a benchmarking and validation dataset for biological image segmentation. While the primary target is biological images, we believe that the dataset would ..." [ more ]

  • Elisa Drelie Gelasca, Jiyun Byun, Boguslaw Obara and B.S. Manjunath,
    " Benchmark for evaluating biological image analysis tools "
    Workshop on Bio-Image Informatics: Biological Imaging, Computer Vision and Data Mining, Santa Barbara, CA, USA, Jan. 2008.

    Abstract preview: "Biological images are critical components for a detailed understanding of the structure and functioning of cells and proteins. Image processing and analysis tools increasingly play a significant role ..." [ more ]


 
CBIR (Cortina)
Recent advances in processing and networking capabilities of computers have led to an accumulation of immense amounts of multimedia data such as images. One of the largest repositories for such data is the World Wide Web (WWW). We present Cortina, a large-scale image retrieval system for the WWW. Cortina v.3 indexes still over 10 Million images using image content, text and annotations At the systems level, the components of Cortina include building image collections using a Web crawler, collecting category information and keywords, and processing images to compute content descriptors. In this last version of Cortina the user has 4 options to start a search as shown in the Screen Shot on the right. Keyword query, to do a keyword or text search within the existing images, upload an image or insert the URL, browse images in the database randomly, or cluster to visualize images in its semantic clusters.[read more]

Related Papers:

You can find all details concerning the method in the following papers:

 

  • E. Drelie Gelasca, S. Joshi, J. Kleban, S. Mangiat, B.S. Manjunath, E. Moxley, A. Sarkar, and J. Xu,
    " The Vision Research Lab of UCSB at TRECVID 2007 "
    Proc. Proceedings of the TRECVID 2007 Workshop, Nov. 2007.

    Abstract preview: "The Vision Research Lab at the University of California at Santa Barbara participated in three TRECVID 2007 tasks: rushes summarization, high level feature extraction, and search. This paper describes..." [ more ]

  • Pratim Ghosh, E. Drelie Gelasca, K.R. Ramakrisnan and B.S. Manjunath,
    " Duplicate Image Detection in Large Scale Databases "
    Book Chapter in Platinum Jubilee Volume, Indian Statistical Institute, Kolkata, Oct. 2007.

    Abstract preview: "We propose an image duplicate detection method for identifying modified copies of the same image in a very large database. Modifications that we consider include rotation, scaling and cropping. A comp..." [ more ]

  • Elisa Drelie Gelasca, Joriz De Guzman, Steffen Gauglitz, Pratim Ghosh, JieJun Xu, Emily Moxley, Amir M. Rahimi, Zhiqiang Bi and B. S. Manjunath,
    " CORTINA: Searching a 10 Million + Images Database "
    Technical Report, VRL, ECE, University of California, Santa Barbara, Sep. 2007.
  • Abstract preview: "We present an image search and retrieval system, Cortina, that indexes over 10 Million images using image content, text and annotations. This large collection of image data, gathered from the World Wi..." [ more ]
 
3D Watermarking Quality Assessemt
One of the most important requirement of digital watermarking algorithms is imperceptibility. This requirement is particularly severe for watermarking of 3D objects where the visual quality of the original model has to be preserved, i.e. the visual aspect of the watermarked object should be the same of the original one. Several watermarking methods for still images and video exploit the knowledge of the Human Visual System (HVS) to obtain imperceptibility maximizing robustness. Since now, no similar techniques for watermarking of 3D objects exist. Here, we present a new experimental methodology for subjective evaluations of 3D objects and two perceptual metrics for quality assessment of watermarked 3D objects. Such metrics have been developed combining roughness estimation of model surface with psychophysical data collected by subjective experiments based on the proposed methodology. Such metrics can be useful for the evaluation and comparison of the perceptual artifacts introduced by 3D watermarking algorithms. The final aim of the evaluation is to minimize extraneous detail introduced by the watermarking by modulating the watermarking insertion in order to improve the visual quality of the watermarked model. Concerning comparison the performance of different 3D watermarking algorithms can be measured on the basis of the artifacts perceived on the 3D model.

Related Papers:

You can find all details concerning the method in the following papers:

Massimiliano Corsini, Elisa Drelie Gelasca, Touradj Ebrahimi, "Watermarked 3D Object Quality Assessment", Technical Report 2004/29, Signal Processing Institute (ITS), Ecole Polytechnique Fédérale de Lausanne (EPFL), Switzerland. M. Corsini, E. Drelie Gelasca and T. Ebrahimi
"A Multi-Scale Roughness Metric for 3D Watermarking Quality Assessment", Workshop on Image Analysis for Multimedia Interactive Services 2005, April 13-15, Montreux, Switzerland., April 2005 E. Drelie Gelasca, T. Ebrahimi, M. Corsini and M. Barni
"Objective Evaluation of the Perceptual Quality of 3D Watermarking"
IEEE , IEEE International Conference on Image Processing (ICIP), Genoa, Italy, September 2005

M. Corsini, E. Drelie Gelasca, T. Ebrahimi and M. Barni
"Watermarked 3D Mesh Quality Assessment"
submitted to IEEE Transactions on Multimedia, 2006


Download Software:

3DWPM is a tool to predict the human perception of geometric defects introduced by 3D watermarking algorithms on the model surface.

3DWPM is freely available for Win2000/NT:

- 3DWPM (version 1.0) - [available soon on the web site...]

Please, note that to work properly 3DWPM requires the OpenGL libraries. If you want to download the software or if you have comments feel free to contact its authors using the following email addresses (replace "_at_" with "@") :corsini_at_isti.cnr.it elisa.drelie_at_epfl.ch

Video Object Segmentation Quality Assessemt

Segmentation of moving objects in image sequences plays an important role in video processing and analysis. Evaluating the quality of segmentation results is necessary
to allow the appropriate selection of segmentation algorithms and to tune their parameters for optimal performance.
Many segmentation algorithms have been proposed along with a number of evaluation criteria. Nevertheless, very few comparative studies of the quality of different segmentation results have been conducted. In this project, a generic framework for segmentation quality evaluation is considered, as well as specific applications. Both subjective and objective evaluation criteria are introduced to overcome some of the limitations of existing approaches. On the basis of subjective results, perceptual factors are introduced in the objective metric to meet the specificities of different applications. Experimental results confirm the efficiency of the proposed evaluation criteria with respect to three state of the art metrics.The first state of the art metric, MPEGqm is a simple sum of spatial and temporal errors commonly used by the research community. The second metric, wqm is a refinement of the first one where false positive and false negative errors are distinguished and weighted differently in the final formula. The third state of the art metric, mqm combines several simple metrics to classify the errors into split and merge errors, detection failures and false alarms. None of the state of the art objective methods includes the characterization of artifact perception in their models.Method :The proposed discrepancy method is defined on two kinds of metrics, namely the objective metric and the perceptual metric. First, the objective metric classifies and quantifies the deviation of the segmentation result from the reference. Second, segmentation errors are measured through the proposed objective criteria and their perception is studied and characterized by means of subjective experiments.
Finally, the perception of segmentation errors is modeled and incorporated in the proposed perceptual metric.
The novelty of our approach consists in classifying the different clusters of error pixels according to the following characteristics: if they do (border holes, added brackground) or they do not modify (inside holes, added regions) the shape of the object and afterward their size.

 

Experimental Results :

In the experiments, we used seven exisiting static background segmentation methods. Tuning of parameters has been done on a small data set of each algorithm according to subjective evaluation criteria and kept for each data.
The expected segmentation quality for a given application can often be translated into requirements related to the shape precision and the temporal coherence of the objects to be produced by the segmentation algorithm. The setting up of a subjective experiment differs for each application.
Therefore, our experiments are focused on two kinds of applications for segmented objects: video compression and video surveillance.

In the compression scenario, the weights obtained for added regions and background were really small compared to those for inside and border holes. In fact, in this application we have preserved the quality of the segmented objects and compressed the background. Therefore, the parts of the object that have been erroneously segmented as part of the background have been compressed and annoy the subjects more than having segmentation artifacts like added region or background that have not be compressed.
In the surveillance application the biggest annoyance weights are given to added regions and inside holes. This can be explained by the fact that human viewers in the surveillance scenario pay attention to mis-detected or overdetected objects that could lead to false alarms (in case of erroneous detection of background parts as moving objects) and missed alarms (in case of mis-detection of moving objects).

The performance of the new metric was also analyzed in terms of correlation with subjective scores and compared to those of the three considered state of the art metrics. It could be shown that the proposed perceptual objective metric provides superior performance to those of the state of the art MPEGqm, wqm and mqm.

Related Publications:

PhD Thesis: E. Drelie Gelasca "Full-Reference Objective Quality Metrics for Video Watermarking, Video Segmentation and 3D Model Watermarking.", December 2005, EPFL, Lausanne, Switzerland. Invited paper: E. Drelie Gelasca and T. Ebrahimi,
"On Evaluating Metrics For Video Segmentation Algorithms "
INTEL, VPQM 2006 Second International Workshop on Video Processing and Quality Metrics for Consumer Electronics, Scottsdale, Arizona, Arizona, USA, January 2006 E. Drelie Gelasca, T. Ebrahimi, M. Farias, M. Carli and S. Mitra
"Annoyance of Spatio-Temporal Artifacts in Segmentation Quality Assessment", IEEE , International Conference on Image Processing, October 2004.E. Drelie Gelasca, T. Ebrahimi, M. Farias, M. Carli and S. Mitra
"Towards Perceptually Driven Segmentation Evaluation Metrics"
IEEE , CVPR 2004 Workshop (Perceptual Organization in Computer Vision), June 2004 E. Drelie Gelasca, T. Ebrahimi, M. Farias and S. Mitra
"Impact of Topology Changes in Video Segmentation Evaluation"
IEEE , Workshop on Image Analysis for Multimedia Interactive Services, April 2004 E. Drelie Gelasca, E. Salvador and T. Ebrahimi
"Intuitive Strategy for Parameter Setting in Video Segmentation"
in Proc. of SPIE, SPIE, Visual Communications and Image Processing 2003, Vol. 5150, pp. 998-1008, July 2003.

A. Cavallaro, E. Drelie Gelasca and T. Ebrahimi
"Objective evaluation of segmentation quality using spatio-temporal context", Proc. of IEEE International Conference on Image Processing, pp. pp. 301-304, September 2002


Download Software:

A graphical user interface is available to run the subjective tests. The inputs are the test video sequences in .avi format and a list (in txt. format) of the name of the test video sequences in the desired order in which they should be played. The outputs are .txt files with the corresponding annoyance value (a .txt file for each video sequence with as many annoyance values as the number of subjects who attended to the experiment). The software has been implemented in Microsoft Visual Basic 6.0. It has been tested under Windows XP.

If you want to download the software or if you have comments feel free to contact its authors using the following email addresses (replace "_at_" with "@") :elisa.drelie_at_epfl.ch

 

 





I am soooo fake pre-loading this image so the navigation doesn't skip while loading the over state.  I know I could use the sliding doors technique to avoid this fate, but I am too lazy.