If you're fire and are specced into Pryromaniac (You get 10% haste if 3 or more targets are effected by Fire spells) and then the mobs despawn (The orbs on Blood Prince council for example) the buff can become permanent and it will stay even if you switch specs.