- Changed User-agent header: I saw a number of sites that forbid
- "Mozilla compatible" browsers. Added a number of fake headers to pretend
- this is a real web-browser - there are still stupid sites
- that are trying to protect themselves from robots by analyzing headers.