In addition to disease, a key issue in many climates is toilet paper. Your average deer isn't leaving around white paper that takes a decade (in dry climates) to go away. That's a non issue in wet areas, but a large one in deserts and more arid regions.