So should I delete ROM from my computer and download 6.0.6? I started to download one of the Bins, and it said it would take 5 hours, so I'm not sure if downloading all of them would save time.
This would be the way to go; installing 30-40 patches between two "chapters" not only takes a very long time but can also be problematical--far more chances to have corrupted files. You would be better off manually downloading and installing the 6.0.6 client, then updating from there.
Download speed will depend on your own nominal download/sec speed. Basic internet (~ 1.5Mbit/sec), while using a wireless connection is far slower than a nominal 10-15-20-25 Mbit/sec speed. I could see some of the larger game files taking 2-3 hours to download.