Not all civilizations did. But you're right that most of the world's earliest civilizations appeared in regions that benefited from the presence of rivers. In Mesopotamia, it's the Euphrates and Tigris. In Egypt, it was the Nile. In China, it was the Yellow River. And in India, it was the Indus River. read more
Mainly because river plains had fertile soil, thereby helping in cultivation. Moreover, river facilitate cheap transportation (as other forms of tranaportation were simply not there or were not cost effective). read more