understand this:
Pipes define the max speed
Queues define how much band will each type of package have in a stress situation
Rules define what type is each package
when a queue A has a value of 10 and B a value of 90, if the total band is 1000kb/s then
if B is not using the net, A can get 1000kb/s.
But in a stress situation(every one wants all net to them) the shaper ensures that A always has 100kb/s and B always have 900kb/s
In your example, you should have 2 queues.
one for your server and one for everything else connected to the same upload pipe(this is only for upload, you can do it for download to with a different pipe and queues)
96Kb / 600Kb = 16%
so the server queue should have 16 as value
the queue for everything else should have 84 as value
I hope this solves your problem.
The problem with what you've describe though is that that doesn't prioritize a port, all it does is prioritize what ever ports you've got being filtered, giving them a designation such as one being low priority and other being high priority etc. What about if you want a specific machine to have only 5% of the connection regardless of the ports, and another 50% regardless of the ports, well then you're SOL in this situation. I believe the only way (which I haven't seen or tried) is to have an additional ethernet card in the firewall to handle that specific network segment or even machine.