CRTs do not display the whole image they receive. Part of the image falls outside the visible region. This is called overscan. I think your capture card does not do any overscan so the blue box is visible.
The blue box is bigger on emulator, so I suppose that the N64 already crops a part of the rendered image when sending it to the TV.
I have no clue what the meaning of the blue box is.