For the given problem, we know the following information:
- The angle of the prism is \( S_0 = 50^\circ \).
- The angle \( r \) inside the prism varies with time as \( r = 10^\circ + t^2 \).
Using Snell’s Law and the fact that the sum of the angles inside a prism equals the angle of the prism, we can relate the change in the angles \( r \) and \( r' \). The variation of \( r' \) is linked to \( r \), and since \( r = 10^\circ + t^2 \), we can use the relationship between these angles to determine the functional dependence of \( r' \) over time.
Thus, \( r' \) will vary as \( r' = 50^\circ - t^2 \).
Therefore, the correct answer is option (4): \( 50^\circ t^2 - t^2 \).