I think your expectations are too high. There are no cameras available to the general public that produce no noise at ISO 4000. And since you are looking at a NEF with no post processing whatever, I'm absolutely not surprised to see that noise.
_____ Brian... a bicoastal Nikonian and Team Member
My gallery is online. Comments and critique welcomed any time!