be paitient and dont be scared..get friendly with them..tell them u dont like jokes and funny stuff and niether ur family and i m serious about this(i may sound crazy)it worked for me...and if u r a muslim u can try other things too like i did.they are now friendly with me.but yes they do wake me up early in the morning for fajar.

if u can move out that would be best.