§ Of the Rings of Power and the Third Age The Silmarillion

Elsewhere in Middle-earth there was peace for many years; yet the lands were for the most part savage and desolate, save only where the people of Beleriand came. Many Elves dwelt there indeed, as they had dwelt through the countless years, wandering free in the wide lands far from the Sea; but they were Avari, to whom the deeds of Beleriand were but a rumour and Valinor only a distant name. And in the south and in the further east Men multiplied; and most of them turned to evil, for Sauron was at work.