The following URL mentions the problem and gives a solution:
http://blog.tmcnet.com/blog/tom-keating/microsoft/remote-desktop-slow-problem-solved.asp
The solution that I used was to open a command prompt with admin privileges and run the command:
netsh interface tcp set global autotuninglevel=disabled