Yes, it was an mtu problem. Thanks.
Now the problem is configuring the router's MTU so it works without changing each machine.
I think you will find that this probably will not work. It's the TCP/IP stack on the machine initiating the connection (machine behind the router) that sends the MTU message out to the other end, and it's the other end that is sending packets that are too large.