It is more the fact we are isolated. The only Hylians to be allowed in the Zora Domain were those who bore the symbol of the royal family. The Guredo are thieves, and live in the distant sands of the desert in the far western region. The Gorons live high atop Death Mountain. The Koriki are, to most, little more than myth as they live in the shadow of the Great Deku Tree deep in the southern forests. And the Sheikath... well, they are almost extinct. I know of only two remaining members of that tribe.