Does the new button have a tapered mounting pin? I ask this because the brass insert may have a tapered hole in it. Nikon may have used an adhesive or melted the back side of the button shaft. The two Phillips drive screws look too inviting to me to leave alone. Hopefully the metal mount plate can be removed without getting into the complex switch contact setup. Good luck if you proceed any further.