User-agent: * Request-rate: 1/5 # Maximum request rate of 1 page every 5 seconds (12/minute) Crawl-delay: 5 # Used by several bots (12/minute)
LINK Discount stores |
Discount TV
|
Camera World
|
Discount DVD
|
Discount Mp3 Player
|
Discount Software
LINK Partners |
mobile download
|
thaidatacompany
