ImageNet
≈ 8 min read
Names in other languages
No names in other languages are held for this entry yet.
Article bodies are English and are not machine-translated. A name in another language is not a translation of the article.
The ImageNet project is a large visual database designed for use in visual object recognition software research. More than 14 million images have been hand-annotated by the project to indicate what objects are pictured and in at least one million of the images, bounding boxes are also provided. ImageNet contains more than 20,000 categories, with a typical category, such as "balloon" or "strawberry", consisting of several hundred images. The database of annotations of third-party image URLs is freely available directly from ImageNet, though the actual images are not owned by ImageNet. Since 2010, the ImageNet project runs an annual software contest, the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), where software programs compete to correctly classify and detect objects and scenes. The challenge uses a "trimmed" list of one thousand non-overlapping classes.
The ImageNet project is a large visual database designed for use in visual object recognition software research. More than 14 million images have been hand-annotated by the project to indicate what objects are pictured and in at least one million of the images, bounding boxes are also provided. ImageNet contains more than 20,000 categories, with a typical category, such as "balloon" or "strawberry", consisting of several hundred images. The database of annotations of third-party image URLs is freely available directly from ImageNet, though the actual images are not owned by ImageNet. Since 2010, the ImageNet project runs an annual software contest, the ImageNet Large Scale Visual Recognition Challenge (ILSVRC), where software programs compete to correctly classify and detect objects and scenes. The challenge uses a "trimmed" list of one thousand non-overlapping classes.
History
AI researcher Fei-Fei Li began working on the idea for ImageNet in 2006. At a time when most AI research focused on models and algorithms, Li wanted to expand and improve the data available to train AI algorithms. In 2007, Li met with Princeton professor Christiane Fellbaum, one of the creators of WordNet, to discuss the project. As a result of this meeting, Li went on to build ImageNet starting from the roughly 22,000 nouns of WordNet and using many of its features.
She was also inspired by a 1987 estimate that the average person recognizes roughly 30,000 different kinds of objects. As an assistant professor at Princeton, Li assembled a team of researchers to work on the ImageNet project. They used Amazon Mechanical Turk to help with the classification of images. Labeling started in July 2008 and ended in April 2010. It took 49K workers from 167 countries filtering and labeling over 160M candidate images. They had enough budget to have each of the 14 million images labelled three times.
The original plan called for 10,000 images per category, for 40,000 categories at 400 million images, each verified 3 times. They found that humans can classify at most 2 images per second. At this rate, it was estimated to take 19 human-years of labor (without rest). They presented their database for the first time as a poster at the 2009 Conference on Computer Vision and Pattern Recognition (CVPR) in Florida, titled "ImageNet: A Preview of a Large-scale Hierarchical Dataset". The poster was reused at Vision Sciences Society 2009.
In 2009, Alex Berg suggested adding object localization as a task. Li approached PASCAL Visual Object Classes contest in 2009 for a collaboration. It resulted in the subsequent ImageNet Large Scale Visual Recognition Challenge starting in 2010, which has 1000 classes and object localization, as compared to PASCAL VOC which had just 20 classes and 19,737 images (in 2010).
Dataset
ImageNet crowdsources its annotation process. Image-level annotations indicate the presence or absence of an object class in an image, such as "there are tigers in this image" or "there are no tigers in this image". Object-level annotations provide a bounding box around the (visible part of the) indicated object. ImageNet uses a variant of the broad WordNet schema to categorize objects, augmented with 120 categories of dog breeds to showcase fine-grained classification. In 2012, ImageNet was the world's largest academic user of Mechanical Turk.
The average worker identified 50 images per minute. The original plan of the full ImageNet would have roughly 50M clean, diverse and full resolution images spread over approximately 50K synsets. This was not achieved. The summary statistics given on April 30, 2010: Total number of non-empty synsets: 21841 Total number of images: 14,197,122 Number of images with bounding box annotations: 1,034,908 Number of synsets with SIFT features: 1000 Number of images with SIFT features: 1.2 million
History of the ImageNet challenge
The ILSVRC aims to "follow in the footsteps" of the smaller-scale PASCAL VOC challenge, established in 20051, which contained only about 20,000 images and twenty object classes. To "democratize" ImageNet, Fei-Fei Li proposed to the PASCAL VOC team a collaboration, beginning in 2010, where research teams would evaluate their algorithms on the given data set, and compete to achieve higher accuracy on several visual recognition tasks. The resulting annual competition is now known as the ImageNet Large Scale Visual Recognition Challenge (ILSVRC).
The ILSVRC uses a "trimmed" list of only 1000 image categories or "classes", including 90 of the 120 dog breeds classified by the full ImageNet schema. The 2010s saw dramatic progress in image processing. The first competition in 2010 had 11 participating teams. The winning team was a linear support vector machine (SVM). The features are a dense grid of HoG and LBP, sparsified by local coordinate coding and pooling. It achieved 52.9% in classification accuracy and 71.8% in top-5 accuracy.
It was trained for 4 days on three 8-core machines (dual quad-core 2 GHz Intel Xeon CPU). The second competition in 2011 had fewer teams, with another SVM winning at top-5 error rate 25%. The winning team was XRCE by Florent Perronnin, Jorge Sanchez. The system was another linear SVM, running on quantized Fisher vectors. It achieved 74.2% in top-5 accuracy. In 2012, a deep convolutional neural net called AlexNet achieved 84.7% in top-5 accuracy, a great leap forward.
The second place was by Oxford VGG, which uses the previous generic architecture of SVM, SIFT, color statistics, Fisher vectors, etc. In the next couple of years, top-5 accuracy grew to above 90%. While the 2012 breakthrough "combined pieces that were all there before", the dramatic quantitative improvement marked the start of an industry-wide artificial intelligence boom. In 2013, most high-ranking entries used convolutional neural networks.
The winning entry for object localization was the OverFeat, an architecture for simultaneous object classification and localization. The winning entry for classification was an ensemble of multiple CNNs by Clarifai. By 2014, more than 50 institutions participated in the ILSVRC. The winning entry for classification was GoogLeNet. The winning entry for localization was VGGNet. In 2017, 29 of 38 competing teams had greater than 95% accuracy.
In 2017 ImageNet stated it would roll out a new, much more difficult challenge in 2018 that involves classifying 3D objects using natural language. Because creating 3D data is more costly than annotating a pre-existing 2D image, the dataset is expected to be smaller. The applications of progress in this area would range from robotic navigation to augmented reality. In 2015, the winning entry was ResNet, which exceeded human performance.
However, as one of the challenge's organizers, Olga Russakovsky, pointed out in 2015, the ILSVRC is over only 1000 categories; humans can recognize a larger number of categories, and also (unlike the programs) can judge the context of an image. In 2016, the winning entry was CUImage, an ensemble model of 6 networks: Inception v3, Inception v4, Inception ResNet v2, ResNet 200, Wide ResNet 68, and Wide ResNet 3. The runner-up was ResNeXt, which combines the Inception module with ResNet.
In 2017, the winning entry was the Squeeze-and-Excitation Network (SENet), reducing the top-5 error to 2.251%. The organizers of the competition stated in 2017 that the 2017 competition would be the last one, since the benchmark has been solved and no longer posed a challenge. They also stated that they would organize a new competition on 3D images. However, such a competition never materialized.
Text derived from https://en.wikipedia.org/w/index.php?oldid=1377738480 under CC BY-SA 4.0; modifications have been made.
References
- ↩Wikipedia “ImageNet” date of establishment (×1) · confidence 0.95 revision URL