User-agent: almaden User-agent: ASPSeek User-agent: baiduspider User-agent: dumbBot User-agent: Generic User-agent: grub-client User-agent: MSIECrawler User-agent: NexaBot User-agent: NPBot User-agent: OWR_Crawler User-agent: psbot User-agent: rabaz User-agent: RPT-HTTPClient User-agent: ScoutAbout User-agent: semanticdiscovery User-agent: TurnitinBot User-agent: Wget User-agent: Baiduspider* User-agent: CFNetwork* User-agent: DoCoMo* User-agent: Eurobot* User-agent: Feed43* User-agent: Gaisbot* User-agent: Infordat* User-agent: Jyxobot* User-agent: libwww-perl* User-agent: msnbot* User-agent: msnbot-media* User-agent: rssdirectory-bot* User-agent: Seekbot* User-agent: Speedy* User-agent: SygolBot* User-agent: *slurp* User-agent: Slurp User-agent: Googlebot User-agent: *bot* Disallow: *tx_delibereadweb_pi1* Request-rate: 1/15 Visit-time: 0500-0800