This question was proposed by Tony García on Facebook. Here is a solution that includes
Mathematica calculations. The
Descartes formula for circles touching other three mutually tangent circles is also used.
Solution
These are the values of
R1 (radius of upper red circle) and
R2 (radius of lower red circle) in terms of the side
a of the square.
\[R = \frac{{ab}}{{b + c}},\quad r = \frac{{a(aR + bc)}}{{{b^2}}}\left( {1 - \sqrt {1 - \frac{{{b^4}}}{{{{(aR + bc)}^2}}}} } \right).\] Aproximadamente, $R=13.04726$ y $r=6.17347$.