Lol yeah, it was pretty intense watching the data streams between my test server and client. Soon as I realized what was going on, I figured that it was the root of the latency issues.
Pretty much it was approximately 100-120 illusion packets being sent to each client per minute. Times that by 20-40ish clients in a zone and yeah... I'm surprise the server was actually able to handle it as well as it did.