OK - so there's your problem. It's not possible to choose an AF point with the camera in that mode - the camera determines which AF point(s) to use based on where the closest object is positioned in the frame.
Change to Single-area AF or plain Dynamic-area AF (i.e. without closest subject priority) and you'll be able to select the AF point you want. Single-area AF is the lowest of the four positions for the AF-Area selector on the rear of the camera
The only way the lens affects this issue is that, if the lens is in MF, it forces the camera into Single-area AF - whatever AF-Area Mode you had chosen.