For single slit diffraction, first minimum occurs at:
\[
a\sin\theta = \lambda
\]
Given:
\[
\lambda = 500\text{ nm}=5\times 10^{-7}\text{ m}
\]
\[
a=0.1\text{ mm}=10^{-4}\text{ m}
\]
So,
\[
\sin\theta=\frac{\lambda}{a}
=\frac{5\times 10^{-7}}{10^{-4}}
=5\times 10^{-3}
\]
\[
\sin\theta=0.005
\]
Thus,
\[
\theta=\sin^{-1}(0.005)
\]
Hence, the correct answer is:
\[
\boxed{(D)\ \sin^{-1}(0.005)}
\]