As the initial joy of Ramadan wears off, the labour of fielding prejudice creeps in