Hint $\ $ Write $\displaystyle\ f(x) = c_0 + c_1 {x \choose 1} + \cdots + c_4 {x \choose 4},\ $ possible since $\displaystyle {x\choose k}\,$ has degree $k$. Then
$$\begin{eqnarray} f(0) &=& c_0 \\ f(1) &=& c_0 + {1\choose 1} c_1 \\ f(2) &=& c_0 + {2\choose 1} c_1 + {2\choose 2} c_2 \\ f(3) &=& c_0 + {3\choose 1} c_1 + {3\choose 2} c_2 + {3\choose 3} c_3 \\ f(4) &=& c_0 + {4\choose 1}c_1 + {4\choose 2}c_2 + {4\choose 3} c_3 + {4\choose 4} c_4 \end{eqnarray}$$
Successively solving the above triangular system for $\,c_0,\ c_1,\ c_2,\ldots$ shows that all $\,c_i\in \Bbb Z$, since all $f(i), {j\choose k}\in \Bbb Z\,$ and each linear equation in $\,c_i\,$ is monic, i.e. has lead coef $= {i\choose i} = 1.\,$ Conversely, if all $c_i\in \Bbb Z$ then $f(n)\in \Bbb Z$ since all ${x \choose i}$ are integer valued.
Thus $f(x)$ is integer-valued $\iff$ its coefficients in a binomial basis are all integers.
Clearly the same proof works for polynomial of any degree.
These are known as integer-valued polynomials.. Above is a classical result of Polya and Ostrowski (1920) that any integer valued polynomial, i.e. any $\,f(x)\in \mathbb Q[x]\,$ with $\,f(\mathbb Z)\subset \mathbb Z,\,$ is an integral linear combination of binomial coefficients $\,{x \choose k},\,$ see for example Polya And Szego, Problems and theorems in analysis, vol II, Problem 85 p. 129 and its solution on p. 320.
These results have been extended from $\,\Bbb Z\,$ to much more general rings (e.g. Dedekind domains) by Cahen at al. I don't believe that there is any standard notation to denote such rings, though I recall that some ring-theorists use the notation $\,{\rm Int}(D)$ or something similar. A search on "integer-valued polynomials" should locate much interesting literature. This paper is one convenient place to start at: J. L. Chabert, $ $ An overview of some recent developments on integer-valued polynomials. 2010.