The kaaba is the most sacred place for muslims, it's the center of the world for them, it's their gravitational center. Destroying Kaaba is like knocking down a beehive with a stick, you will end up with all the bees attacking you. read more
The Kaaba would be rebuilt post-haste. It wouldn't be the first time it had been destroyed. Generally, there does seem to be a misunderstanding about the Kaaba. read more
Personally, I don't think it would affect me on a massive scale. read more