Hmm this is a hard one.

On one hand it is the SHAT and on the other I can see your points about not wanting to intrude on his private time.

From what I know of you, you will be quite respectful and not one of *those* fans. I say go, just because how often will you get another chance like this?