Lesson plan

Hinge loss

In machine learning, hinge loss is a loss function used for training classifiers. Hinge loss is used for "maximum-margin" classification, most notably for support vector machines (SVMs). For an intended output and a classifier score , the hinge loss of the prediction is defined as: : \ell(y) = \max(0, 1-t \cdot y) Note that y should be the "raw" output of the classifier's decision function, not the predicted class label. For instance, in linear SVMs, y = \mathbf{w} \cdot \mathbf{x} + b , where (\mathbf{w},b) are the parameters of the hyperplane and \mathbf{x} is the input variable(s). When and have the same sign (meaning predicts the correct class) and |y| \ge 1 , the hinge loss \ell(y) = 0 . When they have opposite signs, \ell(y) increases linearly with , and similarly if |y| , even if it has the same sign (correct prediction, but not by enough margin). Hinge loss is not a proper scoring rule.

Back to article

Article summary

In machine learning, hinge loss is a loss function used for training classifiers. Hinge loss is used for "maximum-margin" classification, most notably for support vector machines (SVMs). For an intended output and a classifier score , the hinge loss of the prediction is defined as: : \ell(y) = \max(0, 1-t \cdot y) Note that y should be the "raw" output of the classifier's decision function, not the predicted class label. For instance, in linear SVMs, y = \mathbf{w} \cdot \mathbf{x} + b , where (\mathbf{w},b) are the parameters of the hyperplane and \mathbf{x} is the input variable(s). When and have the same sign (meaning predicts the correct class) and |y| \ge 1 , the hinge loss \ell(y) = 0 . When they have opposite signs, \ell(y) increases linearly with , and similarly if |y| , even if it has the same sign (correct prediction, but not by enough margin). Hinge loss is not a proper scoring rule.

Key claims

No claims recorded.

Discussion questions

  1. Summarise the article in your own words. Which single claim would you verify first, and why?
  2. Which claim in this article is most likely to be revised as the sources update? How would you check its current status?
  3. If two sources disagreed about one of these facts, what would you need in order to trust one over the other?

Bibliography

No sources recorded.

Key claims and bibliography are generated from the same tracked claims and sources as the article page.