1x07 Chapter Seven: Feast of Feasts

I don't understand why they vilified Harvey for hunting. What's the problem with him shooting a deer? He had no way to know it was a familiar.