White man denies saying ‘Go back where you came from’