If it is something that just started happening with no changes to your own infrastructure, you may want to check with your ISP as they may have made some changes to your connection (such as throttling each connection to a max speed).
Oh yeah, I forgot to mention that I tried this wihtout using the firewall, and then it is back to normal upload speed. So the problem is somewhere around my FW.