Yes, if autistic people were in the majority, neurotypical people would be described or perceived as lacking in empathy. Once you realize that, you see that it works both ways.

https://www.autism.org.uk/advice-and-guidance/professional-practice/double-empathy

It’s quite similar to what I am experiencing with regards to the people in the island town that I am in. They think I am nuts or wrong; I think they’re nuts or wrong. We’re used to a very different way of being and way of experiencing the world. It’s teaching me more about what life must be like for autistic people.

I’ve argued before that cultural differences are a form of neurodiversity. If you disagree, then you may want to consider things like that which language your speak can determine how you experience time.