After looking into some reports you guys provided it seems the limit may have not been working exactly as intended. Working properly you really shouldn't see it, even in fairly normal 'farming' conditions, or reasonable amounts of character swapping. We're shutting it off until we can take a better look at it tomorrow.
take input limit off - Forums - Diablo III