On the Nectar Fairy, I have had a situation where if you recharge too fast it stops reducing cooldowns permanently. Also, using recharge twice in quick succession takes charges for both casts but wont update cooldowns. I recommend that recharge should wait until cooldowns have actually been reduced.
This has happened to me too. With that said, it hasn't happened for a couple days. Maybe I have been going slower while using Recharge?
