Kill the birds before they debuff you and your party. Alternatively, if there is anyone in party who didn't get the debuff, if they kill something (anything) in "combat" range of you, your debuff will be removed. Oh, and it is totally possible to bug him still, just not the old way. I will not get into details here because it is an exploit, and honestly, I just buff up and kill him before the birds even show up now, lol.