If two numbers leave the same remainder when divided by $n$, then their difference is divisible by $n$.
Difference:
\[
34041 - 32506 = 1535
\]
We need a three-digit divisor of 1535.
Factorising:
\[
1535 \div 5 = 307
\]
Since $307$ is prime and three-digit, $n = 307$.
\[
\boxed{n = 307}
\]