The Department of Homeland Security publicized the discovery of the two firearms in a social media post Sunday.