This is one reason the Enterprise Server is extremely beneficial when talking with remote data sources....it is fast! All of the TDS data, encryption, and compression is applied and there is an absolute minumum of data going across the wire.
It is that age old problem...if you can reproduce it you can fix it