§ Akallabêth The Silmarillion

Now the Elendili dwelt mostly in the western regions of Númenor; but Ar-Gimilzôr commanded all that he could discover to be of this party to remove from the west and dwell in the east of the land; and there they were watched. And the chief dwelling of the Faithful in the later days was thus nigh to the harbour of Rómenna; thence many set sail to Middle-earth, seeking the northern coasts where they might speak still with the Eldar in the kingdom of Gil-galad. This was known to the kings, but they hindered it not, so long as the Elendili departed from their land and did not return; for they desired to end all friendship between then: people and the Eldar of Eressëa, whom they named the Spies of the Valar, hoping to keep their deeds and their counsels hidden from the Lords of the West. But all that they did was known to Manwë, and the Valar were wroth with the Kings of Númenor, and gave them counsel and protection no more; and the ships of Eressëa came never again out of the sunset, and the havens of Andúnië were forlorn.