Game Pad plugged in?

Of course

Then ... use a k/m as it expects. If you have more than one input method that is breaking your access to this very particular menu.

Its either that or you keep wandering away from the build area, but since you don't say whether this is a vanilla location or a modded one, that's probably not it.