User-agent: Teleport Pro/1.29 Disallow: / User-agent: Teleport Pro/1.29.1590 Disallow: / User-agent: Teleport Pro/1.28 Disallow: / User-agent: Offline Explorer/1.1 Disallow: / User-agent: Offline Explorer/1.2 Disallow: / User-agent: Offline Explorer/1.3 Disallow: / User-agent: Offline Explorer/1.4 Disallow: / User-agent: Offline Explorer/1.5 Disallow: / User-agent: Offline Explorer/1.6 Disallow: / User-agent: Offline Explorer/1.7 Disallow: / User-agent: Offline Explorer/1.8 Disallow: / User-agent: Offline Explorer/1.9 Disallow: / User-agent: webcollage/1.93 Disallow: / User-agent: webcollage/1.96 Disallow: / User-agent: webcollage_save/1.93 Disallow: / User-agent: rogerbot Disallow: User-agent: GPTBot Disallow: / User-agent: trendkite-akashic-crawler Disallow: / User-agent: * Allow: /ajax/reference Allow: /ajax/suppliers User-agent: * Disallow: /AdNetwork Disallow: /advert/ Disallow: /adnetwork Disallow: /ajax Disallow: /banner Disallow: /cdn-cgi/* Disallow: /Click Disallow: /clientservices Disallow: /ClientServices Disallow: /Email Disallow: /Email/SupplierListEmail Disallow: /email Disallow: /engineering-search/patents Disallow: /engineering-search/standards Disallow: /featuredproducts/searchresults Disallow: /FeaturedProducts/SearchResults Disallow: /Frames Disallow: /frames Disallow: /goto Disallow: /gotO Disallow: /goTo Disallow: /goTO Disallow: /gOto Disallow: /gOtO Disallow: /gOTo Disallow: /gOTO Disallow: /Goto Disallow: /GotO Disallow: /GoTo Disallow: /GoTO Disallow: /GOto Disallow: /GOtO Disallow: /GOTo Disallow: /GOTO Disallow: /help/spechelp Disallow: /help/spechelpfilter2 Disallow: /help/supplierhelp Disallow: /ListSiteSelfPublish Disallow: /MediaKit/Contact Disallow: /mediakit/contact Disallow: /MediaKit/docs/ratecard.pdf Disallow: /mls Disallow: /MyGlobalSpec Disallow: /MyGlobalspec Disallow: /patents Disallow: /ProductFinder/FindProducts Disallow: /reference/search Disallow: /Registration Disallow: /registration Disallow: /rfq Disallow: /RFQ Disallow: /Search Disallow: /search Disallow: /search/products