A north Georgia man was arrested for allegedly threatening to shoot agents with the Georgia Bureau of Investigation (GBI).