A sheriff is the local executive arm of the local government, specifically judges.  They have powers such a removing someone who has been evicted by a court order.  Police do not have that power.  Sheriffs work for the county, police work for the city.