View source for You Only Look Once

{{Short description|Object detection system}}
{{Infobox software
| author = Joseph Redmon, Santosh Divvala, Ross Girshick, Ali Farhadi
| released = 2015
| latest release version = YOLOv12
| latest release date = 2025-02-20
| programming language = [[Python (programming language)|Python]]
| genre = {{ indented plainlist |
* [[Object detection]]
* [[Convolutional neural network]]
* [[Computer vision]]
}}
| website = {{URL|https://pjreddie.com/darknet/yolo/}}
}}
[[File:Detected-with-YOLO--Schreibtisch-mit-Objekten.jpg|thumb|Objects detected with OpenCV's Deep Neural Network module by using a YOLOv3 model trained on [[COCO (dataset)|COCO]] dataset capable to detect objects of 80 common classes]]
'''You Only Look Once (YOLO)''' is a series of real-time [[object detection]] systems based on [[convolutional neural network]]s. First introduced by Joseph Redmon et al. in 2015,<ref name=":2">{{cite arXiv |eprint=1506.02640 |class=cs.CV |first1=Joseph |last1=Redmon |first2=Santosh |last2=Divvala |title=You Only Look Once: Unified, Real-Time Object Detection |date=2016-05-09 |last3=Girshick |first3=Ross |last4=Farhadi |first4=Ali}}</ref> YOLO has undergone several iterations and improvements, becoming one of the most popular object detection frameworks.<ref name=":0">{{Cite journal |last1=Terven |first1=Juan |last2=Córdova-Esparza |first2=Diana-Margarita |last3=Romero-González |first3=Julio-Alejandro |date=2023-11-20 |title=A Comprehensive Review of YOLO Architectures in Computer Vision: From YOLOv1 to YOLOv8 and YOLO-NAS |journal=Machine Learning and Knowledge Extraction |language=en |volume=5 |issue=4 |pages=1680–1716 |doi=10.3390/make5040083 |doi-access=free |issn=2504-4990|arxiv=2304.00501 }}</ref>

The name "You Only Look Once" refers to the fact that the algorithm requires only one forward propagation pass through the neural network to make predictions, unlike previous region proposal-based techniques like [[Region Based Convolutional Neural Networks|R-CNN]] that require thousands for a single image.

== Overview ==
Compared to previous methods like [[Region Based Convolutional Neural Networks|R-CNN]] and [[OverFeat]],<ref name=":3">{{Citation |last1=Sermanet |first1=Pierre |title=OverFeat: Integrated Recognition, Localization and Detection using Convolutional Networks |date=2014-02-23 |last2=Eigen |first2=David |last3=Zhang |first3=Xiang |last4=Mathieu |first4=Michael |last5=Fergus |first5=Rob |last6=LeCun |first6=Yann|arxiv=1312.6229 }}</ref> instead of applying the model to an image at multiple locations and scales, YOLO applies a single neural network to the full image. This network divides the image into regions and predicts bounding boxes and probabilities for each region. These bounding boxes are weighted by the predicted probabilities.

=== OverFeat ===
OverFeat was an early influential model for simultaneous object classification and localization.<ref name=":3" /><ref>{{Citation |last=sermanet |title=sermanet/OverFeat |date=2024-09-09 |url=https://github.com/sermanet/OverFeat |access-date=2024-09-15}}</ref> Its architecture is as follows:

* Train a neural network for image classification only ("classification-trained network"). This could be one like the [[AlexNet]].
* The last layer of the trained network is removed, and for every possible object class, initialize a network module at the last layer ("regression network"). The base network has its parameters frozen. The regression network is trained to predict the <math>(x, y)</math> coordinates of two corners of the object's bounding box.

* During inference time, the classification-trained network is run over the same image over many different zoom levels and croppings. For each, it outputs a class label and a probability for that class label. Each output is then processed by the regression network of the corresponding class. This results in thousands of bounding boxes with class labels and probability. These boxes are merged until only one single box with a single class label remains.

== Versions ==
There are two parts to the YOLO series. The original part contained YOLOv1, v2, and v3, all released on a website maintained by Joseph Redmon.<ref name=":1">{{Cite web |title=YOLO: Real-Time Object Detection |url=https://pjreddie.com/darknet/yolo/ |access-date=2024-09-12 |website=pjreddie.com}}</ref>

=== YOLOv1 ===
The original YOLO algorithm, introduced in 2015,<ref name=":2" /> divides the image into an <math>S \times S</math> grid of cells. If the center of an object's bounding box falls into a grid cell, that cell is said to "contain" that object. Each grid cell predicts B bounding boxes and confidence scores for those boxes. These confidence scores reflect how confident the model is that the box contains an object and how accurate it thinks the box is that it predicts.

In more detail, the network performs the same convolutional operation over each of the <math>S^2</math>patches. The output of the network on each patch is a tuple as follows:<math display="block">(p_1, \dots, p_C, c_1, x_1, y_1, w_1, h_1, \dots, c_B, x_B, y_B, w_B, h_B)</math>where 

* <math>p_i</math> is the ''conditional'' probability that the cell contains an object of class <math>i</math>, ''conditional'' on the cell containing at least one object.
* <math>x_j, y_j, w_j, h_j</math> are the center coordinates, width, and height of the <math>j</math>-th predicted bounding box that is centered in the cell. Multiple bounding boxes are predicted to allow each prediction to specialize in one kind of bounding box. For example, slender objects might be predicted by <math>j = 2</math> while stout objects might be predicted by <math> j=  1</math>.
* <math>c_j</math> is the predicted [[intersection over union]] (IoU) of each bounding box with its corresponding ground truth.
The network architecture has 24 convolutional layers followed by 2 fully connected layers.

During training, for each cell, if it contains a ground truth bounding box, then only the predicted bounding boxes with the highest IoU with the ground truth bounding boxes is used for gradient descent. Concretely, let <math>j</math> be that predicted bounding box, and let <math>i</math> be the ground truth class label, then <math>x_j, y_j, w_j, h_j</math> are trained by gradient descent to approach the ground truth, <math>p_i </math> is trained towards <math>1 </math>, other <math>p_{i'} </math> are trained towards zero.

If a cell contains no ground truth, then only <math>c_1, c_2, \dots, c_B</math> are trained by gradient descent to approach zero.

=== YOLOv2 ===
Released in 2016, YOLOv2 (also known as YOLO9000)<ref>{{cite arXiv |eprint=1612.08242 |class=cs.CV |first1=Joseph |last1=Redmon |first2=Ali |last2=Farhadi |title=YOLO9000: Better, Faster, Stronger |date=2016-12-25}}</ref><ref>{{Cite web |title=YOLOv2: Real-Time Object Detection |url=https://pjreddie.com/darknet/yolov2/ |access-date=2024-09-12 |website=pjreddie.com}}</ref> improved upon the original model by incorporating batch normalization, a higher resolution classifier, and using anchor boxes to predict bounding boxes. It could detect over 9000 object categories. It was also released on GitHub under the Apache 2.0 license.<ref>{{Citation |last=Rémy |first=Philippe |title=philipperemy/yolo-9000 |date=2024-09-05 |url=https://github.com/philipperemy/yolo-9000 |access-date=2024-09-12}}</ref>

=== YOLOv3 ===
YOLOv3, introduced in 2018, contained only "incremental" improvements, including the use of a more complex backbone network, multiple scales for detection, and a more sophisticated loss function.<ref>{{cite arXiv |eprint=1804.02767 |class=cs.CV |first1=Joseph |last1=Redmon |first2=Ali |last2=Farhadi |title=YOLOv3: An Incremental Improvement |date=2018-04-08}}</ref>

=== YOLOv4 and beyond ===
Subsequent versions of YOLO (v4, v5, etc.)<ref>{{cite arXiv |eprint=2004.10934 |class=cs.CV |first1=Alexey |last1=Bochkovskiy |first2=Chien-Yao |last2=Wang |title=YOLOv4: Optimal Speed and Accuracy of Object Detection |date=2020-04-22 |last3=Liao |first3=Hong-Yuan Mark}}</ref><ref>{{cite arXiv |eprint=2011.08036 |class=cs.CV |first1=Chien-Yao |last1=Wang |first2=Alexey |last2=Bochkovskiy |title=Scaled-YOLOv4: Scaling Cross Stage Partial Network |date=2021-02-21 |last3=Liao |first3=Hong-Yuan Mark}}</ref><ref>{{cite arXiv |eprint=2209.02976 |class=cs.CV |first1=Chuyi |last1=Li |first2=Lulu |last2=Li |title=YOLOv6: A Single-Stage Object Detection Framework for Industrial Applications |date=2022-09-07 |last3=Jiang |first3=Hongliang |last4=Weng |first4=Kaiheng |last5=Geng |first5=Yifei |last6=Li |first6=Liang |last7=Ke |first7=Zaidan |last8=Li |first8=Qingyuan |last9=Cheng |first9=Meng |last10=Nie |first10=Weiqiang |last11=Li |first11=Yiduo |last12=Zhang |first12=Bo |last13=Liang |first13=Yufei |last14=Zhou |first14=Linyuan |last15=Xu |first15=Xiaoming}}</ref><ref>{{cite arXiv |eprint=2207.02696 |class=cs.CV |first1=Chien-Yao |last1=Wang |first2=Alexey |last2=Bochkovskiy |title=YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors |date=2022-07-06 |last3=Liao |first3=Hong-Yuan Mark}}</ref> have been developed by different researchers, further improving performance and introducing new features. These versions are not officially associated with the original YOLO authors but build upon their work.<ref name=":1" /> {{As of|2024}}, there are versions up to YOLO11<!-- before, as of 2023: YOLOv8-->.<ref name=":0" />

== See also ==
* [[Computer vision]]
* [[Object detection]]
* [[Convolutional neural network]]
* [[Region Based Convolutional Neural Networks|R-CNN]]
* [[SqueezeNet]]
* [[MobileNet]]
* [[EfficientNet]]

== References ==
{{reflist}}

== External links ==
* [https://pjreddie.com/darknet/yolo/ Official YOLO website]
* [https://github.com/AlexeyAB/darknet YOLO implementation in Darknet]
{{Differentiable computing}}
[[Category:Computer vision]]
[[Category:Deep learning]]
[[Category:Neural networks]]