Police blamed over stoush with refugees