A Massachusetts man who toured the U.S. Capitol on Tuesday was later found to be carrying a handgun, police officials said.