Although there is no religious text, there are scholarly opinions which supports such practice. Ibn Hajar al-Haithami in Tuhfah al-Muhtaj, vol 1 mentioned:

"Calling out the adhan is sunnah for purpose other than calling for prayer such as to a newborn baby, when there is a disturbance of jinn, in anger also for anyone who has a bad character or attitude whether it is from among humans or animals, during wars and fires… It is also sunnah to call out the adhan and iqamah when there is a disturbance of jinn and shaytan as well as for those who are starting on a journey." (See Tuhfah al-Muhtaj, 1/461)