Maybe my memory is failing me, but I seem to remember people saying the exact opposite here on HN when Tesla first announced/showed off their "self-driving but not really self-driving" features, saying it'll be very easy to get working on the highways, but then everything else is the tricky stuff.
One thing that's hard with highways is the fact that vehicles move faster, so in a tenth of a second at 65 mph, a car has moved 9.5 feet. So if say a big rock fell off a truck onto the highway, to detect it early and proactively brake or change lanes to avoid it, it would need to be detected at quite a long distance, which demands a lot from sensors (eg. how many pixels/LIDAR returns do you get at say 300+ feet on an object that's smaller than a car, and how much do you need to detect it as an obstruction).
But those also happen quite infrequently, so a vehicle that doesn't handle road debris (or deer or rare obstructions) can work with supervision and appear to work autonomously, but one that's fully autonomous can't skip those scenarios.