Step 1: Use Rayleigh's criterion for a telescope.
The angular limit of resolution of a telescope is
\[
\theta=\frac{1.22\lambda}{D},
\]
where
\[
\lambda
\]
is the wavelength of light and
\[
D
\]
is the diameter of the objective lens or mirror.
Step 2: Convert the given quantities into SI units.
Given wavelength,
\[
\lambda=6000\ \text{\AA}.
\]
Since
\[
1\ \text{\AA}=10^{-10}\ \text{m},
\]
\[
\lambda=6000\times10^{-10}.
\]
\[
\lambda=6\times10^{-7}\ \text{m}.
\]
Diameter of telescope,
\[
D=100\ \text{inch}.
\]
Since
\[
1\ \text{inch}=2.54\times10^{-2}\ \text{m},
\]
\[
D=100\times2.54\times10^{-2}.
\]
\[
D=2.54\ \text{m}.
\]
Step 3: Calculate the limit of resolution.
\[
\theta=\frac{1.22(6\times10^{-7})}{2.54}.
\]
\[
\theta=\frac{7.32\times10^{-7}}{2.54}.
\]
\[
\theta\approx2.88\times10^{-7}\ \text{rad}.
\]
\[
\theta\approx2.9\times10^{-7}\ \text{rad}.
\]
Step 4: Final conclusion.
Hence, the limit of resolution of the telescope is
\[
\boxed{2.9\times10^{-7}\ \text{rad}}
\]
Therefore, the correct option is
\[
\boxed{(3)}
\]