What's up with the trope of "seafaring dark skinned people"

ASOIAF- Summer islanders Elder Scrolls- Redguards And I getting into The Wheel of Time which I've learned have, "the sea folk". I know bahamut became a dragon because of dnd, zombies became what they are because of George Romero. But where/ did it this get started? I'm kind of curious