yes, its allowed
They have stopped some people from going inside. Just be sure to state that you have certain business there. One time I was stopped due to the fact that a high level foreign dignitary was coming for a visit and for security reasons they stopped everyone else from entering.