Expected value
Say it: "the expectation of X", "E of X"
What it means
The long-run average of a random variable: (an integral for continuous variables).
Example
You never roll 3.5, but that is the average.
In code
import numpy as np rolls = np.random.default_rng(0).integers(1, 7, 100000) print(round(rolls.mean(), 2))
Output
3.5
Where it appears in machine learning
The loss we really want to minimise is an expectation over all possible data, , estimated by an average over the training set.
Related symbols
Learn it properly in the free lesson Probability & Distributions, with practice questions that check your answers.