Likelihood
Say it: "the likelihood of theta"
What it means
How probable the observed data is, as a function of the parameters: . Training by maximum likelihood picks , usually via the log-likelihood.
Example
In code
import numpy as np p = np.linspace(0.01, 0.99, 99) L = p ** 7 * (1 - p) ** 3 print(round(p[L.argmax()], 2))
Output
0.7
Where it appears in machine learning
Minimising cross-entropy loss is the same as maximising the likelihood of the labels.
Related symbols
Learn it properly in the free lesson Likelihood, MLE & MAP, with practice questions that check your answers.