Minister hits back at Secret Service criticism