User-agent: * Disallow: /admin/ User-agent: panscient.com Disallow: / User-agent: vscooter Disallow: / User-agent: psbot Disallow: / User-agent: ia_archiver Disallow: / User-agent: twiceler Disallow: / User-agent: taptubot Disallow: / User-agent: TwengaBot Disallow: / User-agent: sitebot Disallow: / User-agent: Ezooms Disallow: / User-agent: sistrix Disallow: / User-agent: aiHitBot Disallow: / User-agent: swebot Disallow: / User-agent: EC2LinkFinder Disallow: / User-agent: TurnitinBot Disallow: / User-agent: SearchmetericsBot Disallow: / User-agent: WBSearchBot Disallow: / User-agent: Exabot Disallow: / User-agent: Sosospider Disallow: / User-agent: ip-web-crawler.com Disallow: / User-agent: netEstate NE Crawler Disallow: / User-agent: Aboundexbot Disallow: / User-agent: meanpathbot Disallow: / User-agent: spbot Disallow: / User-agent: archive.org_bot Disallow: / User-agent: LinkpadBot Disallow: / User-agent: EasouSpider Disallow: / User-agent: wotbox Disallow: / User-agent: Aboundexbot Disallow: / User-agent: XoviBot Disallow: / User-agent: A6-Indexer Disallow: / User-agent: Riddler Disallow: / User-agent: LoadTimeBot Disallow: / User-agent: oBot Disallow: / User-agent: Linguee Disallow: / User-agent: sentibot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: MegaIndex.ru Disallow: / User-agent: Barkrowler Disallow: / User-agent: BLEXBot Disallow: / User-agent: YandexImages Disallow: / User-agent: craw.lers.it Disallow: /