The United States Vice President Mike Pence who arrived in Afghanistan on a surprise visit on Thursday night, warned Pakistan against offering safe havens to terrorist groups on its soil.