This is maybe a worthwhile reminder of seeing how the quadratic formula is derived. Here goes. Assume $a \neq 0$.
$$ax^2+bx+c =0 \\ \Leftrightarrow x^2+\frac{b}{a}x +\frac{c}{a} = 0 \\ \Leftrightarrow (x^2+\frac{b}{a}x + (\frac{b}{2a})^2)-(\frac{b}{2a})^2 +\frac{c}{a}=0 \\ \Leftrightarrow (x+\frac{b}{2a})^2 = (\frac{b}{2a})^2-\frac{c}{a} \\ \Leftrightarrow x+ \frac{b}{2a} = \pm \sqrt{\dfrac{b^2-4ac}{4a^2}} =\pm\dfrac{\sqrt{b^2-4ac}}{2a}$$
And now let's check what we need for all these things to truly be equivalences:
- First equivalence: We need to divide by $a$. Possible in fields. If we are just in a commutative domain, we can extend to its field of fractions and get this equivalence.
- Second equivalence: For the extra term to make sense, we need to divide by $2$. Possible (in a possibly enlarged ring) as long as we are in a domain where $2 \neq 0$.
- Third equivalence: True in any commutative ring (binomial formula).
- Fourth equivalence: True if square roots of the term $b^2-4ac$ exist at all and come in a $\pm$ pair, possibly in a larger ring than ours.
So that's all you need.
In a nutshell, the quadratic formula will be true as soon as it makes sense at all -- if you can divide the terms you have by $2a$, and if there are two distinct square roots of $b^2-4ac$ which are each other's negatives. Notice that in commutative domains of characteristic $\neq 2$, this is always doable in some extension field of the field of fraction of our domain.
For a more in-depth answer to some of your good follow-up questions, note the following: what the quadratic formula a.k.a. completing the square achieves in spirit is that it reduces the solution of an arbitrary quadratic equation to (up to basic algebra) finding a certain (pair of) square root(s).
So once you say, you accept the division by $2a$ thing, all insight into your questions must come from (and already apply to) the special case
$$x^2 = d \qquad (*)$$
where $d$ is an element of your "number system", let's call that "number system" $D$. What are solutions to that? If you say, well, the square roots of $d$, then it is hard to argue, but that is just a name for the thing we are looking for. It does not tell us what that thing is, or how many there could be, or what "number system" (possibly bigger than the $D$ we started with) the answer(s) are in. I think these are your questions, and once they are solved for this special case, it's straightforward to go to the general case as per above.
Now I want to convince you that in most cases you are looking at, there can either only be one or two solutions to that. How so? Well, assume I have two solutions $\alpha$ and $\beta$ to (*). Behold:
$$\alpha^2=d=\beta^2 \Rightarrow \alpha^2-\beta^2=0 \stackrel{A}\Leftrightarrow (\alpha-\beta)(\alpha+\beta) = 0 \stackrel{B}\Leftrightarrow (\alpha=\beta \vee\alpha=-\beta)$$
Equivalence A holds iff $\alpha \beta =\beta \alpha$, in particular if you are dealing with commutative rings.
Equivalence B holds if $x\cdot y=0 \implies x=0 \vee y=0$, in particular if you are dealing with rings without zero divisors, a.k.a. "domains".
This shows that in any commutative domain containing the element $d$, equation $(*)$ can have at most two solutions. (In fact, it has exactly two, which are each others negatives -- unless $d=0$, or the characteristic of the domain is $2$: in both these cases, any seemingly two solutions are actually identical to each other)
These solutions, if they exist, are denoted $\pm \sqrt{d}$, but indeed that is a slight abuse of notation. Because for different extensions of $D$, these can be different things. (That is one of the main points of my answer https://math.stackexchange.com/a/4007515/96384: E.g. the two things denoted $\pm \sqrt 2$ in the field $\mathbb Q_7$ are not the same as the two things denoted $\pm \sqrt 2$ in the field $\mathbb R$. The fields $\mathbb Q_p$ and $\mathbb R$ are two different extensions of the "original" number system (here, $\mathbb Q$ or arguably $\mathbb Z$), and in that answer, I warn against this symbol which, if we wanted to be really precise, should always include a notation about what field we are in now. (Like $\pm \sqrt 2 _{\mathbb R}$ or so.)
A good reason why we do not always carry around such symbolism "square root in the domain so-and-so" is that for many practical purposes, it is redundant. In undergraduate math, mostly everything is tacitly understood to be in $\mathbb C$, where anything has square roots, so it's those.
Also, if you find square roots in some domain $E \supset D$, and then you look at an even bigger domain $F\supset E$, the two ones you already had in $E$ will still do the job, and according to what was proven above there cannot be any new ones "on top of that".
Also also, here's something to learn in higher algebra: In our situation ($D$ commutative domain) there is a "universal" solution to $(*)$ in the sense that I can always construct an extension $D'$ of $D$ which does contain solutions to $(*)$, and so that if $E$ is another extension of $D$ containing such solutions, there will be a pair of homomorphisms from $D'$ to $E$ which map the solutions in $D'$ to the ones in $E$. (In a certain sense, this provides us with a "minimal" extension in which we can solve the equation; and any other domain which contains solutions can be seen as a "further" extension of that "minimal" one, where, see last paragraph, nothing new of interest for our equation happens.)
Summing up: If you have never dealt with non-commutative rings, or rings with zero-divisors, it is great that you are a bit careful about what the symbol $\pm\sqrt{d}$ is supposed to mean (because it indeed can mean different things in different rings), but in the sense of the previous three paragraphs, the people who are a bit less precise than you have some good points.
If, on the other hand, you are allowing "number systems" which are not commutative, and/or have zero-divisors, then all hell can break loose, and the notation $\pm\sqrt{}$ should just not be used at all.
Example 1: In the ring $\mathbb Z/12 \mathbb Z$ ("clock numbers", modular arithmetic) the equation $x^2=\bar 1$ has four solutions: $\bar 1, \bar 5, \bar 7, \bar 11$). No one should use the notation $\sqrt{\bar 1}$ for any, or all, of them.
Example 2: In the quaternions, the equation $x^2=-1$ has infinitely many solutions, cf. Solving an equation in quaternions. No one should use the notation $\sqrt{-1}$ for any, or all, of them. (It is still true though that for each individual solution, I can find a commutative subfield of the quaternions which contains that solution and its negative, and none of the others. That is the universality alluded to above. Once one chooses such a subfield, one could call that pair $\pm\sqrt{-1}$ or with a related abuse of notation $\pm i$. But it's not the $i$ in the standard definition of the quaternions: it could be $j$, or $k$, or $\frac{5}{13}i - \frac{12}{13}k$, or...)