This forms an “epsilon neighborhood” of $y$-values.
Now the challenge is to find a corresponding number (most likely similarly tiny):
This number is $\delta$
This forms a “delta neighborhood” of $x$-values.
The limit of the function is $L$ if the function’s $y$-values are always inside the epsilon neighborhood when the $x$-values are in the delta neighborhood (the function always stays within the delta/epsilon rectangle in the picture):
Let $f$ be a function defined on an open interval containing $a$. Then we say that the limit of $f(x)$ as $x$ approaches $a$ is $L$, and we write
$$
\lim_{x\to a} f(x) = L
$$
if for every $\epsilon > 0$ there is a corresponding number $\delta > 0$ so that if
$$
0 < |x - a| < \delta \text{ then } |f(x) - L| < \epsilon
$$