Liste des bots à bloquer robots.txt

Revenir à la lecture du robots.txt

Voici la liste des bots fréquemment bloqués.

Ils ne sont pas tous reconnus comme malveillants mais certains évitent d’être espionné, utilisé souvent dans une stratégie PBN, faîtes un tri… 

User-agent: AlphaSeoBot
User-agent: AlphaSeoBot-SA
User-agent: Baiduspider-favo
User-agent: Baiduspider-cpro
User-agent: Baiduspider-ads
User-agent: Baidu
User-agent: Baiduspider-news
User-agent: Baiduspider-video
User-agent: Baiduspider-image
User-agent: Baiduspider
User-agent: BLEXBot
User-agent: Alexibot
User-agent: AlvinetSpider
User-agent: Antenne Hatena
User-agent: ApocalXExplorerBot
User-agent: asterias
User-agent: BackDoorBot/1.0
User-agent: BizInformation
User-agent: Black Hole
User-agent: BlowFish/1.0
User-agent: BotALot
User-agent: BuiltBotTough
User-agent: Bullseye/1.0
User-agent: BunnySlippers
User-agent: Cegbfeieh
User-agent: CheeseBot
User-agent: CherryPicker
User-agent: CherryPickerElite/1.0
User-agent: CherryPickerSE/1.0
User-agent: CopyRightCheck
User-agent: cosmos
User-agent: Crescent
User-agent: Crescent Internet ToolPak HTTP OLE Control v.1.0
User-agent: DISCo Pump 3.1
User-agent: DittoSpyder
User-agent: dotbot
User-agent: EmailCollector
User-agent: EmailSiphon
User-agent: EmailWolf
User-agent: EroCrawler
User-agent: Exabot
User-agent: ExtractorPro
User-agent: Flamingo_SearchEngine
User-agent: Foobot
User-agent: grapeshot
User-agent: Harvest/1.5
User-agent: hloader
User-agent: httplib
User-agent: HTTrack
User-agent: HTTrack 3.0
User-agent: humanlinks
User-agent: Igentia
User-agent: InfoNaviRobot
User-agent: JennyBot
User-agent: JikeSpider
User-agent: Kenjin Spider
User-agent: LexiBot
User-agent: libWeb/clsHTTP
User-agent: LinkextractorPro
User-agent: LinkScan/8.1a Unix
User-agent: LinkWalker
User-agent: lwp-trivial
User-agent: lwp-trivial/1.34
User-agent: Mata Hari
User-agent: Microsoft URL Control - 5.01.4511
User-agent: Microsoft URL Control - 6.00.8169
User-agent: MIIxpc
User-agent: MIIxpc/4.2
User-agent: Mister PiX
User-agent: MLBot
User-agent: moget
User-agent: moget/2.1
User-agent: MS Search 4.0 Robot
User-agent: MS Search 5.0 Robot
User-agent: Naverbot
User-agent: NetAnts
User-agent: NetAttache
User-agent: NetMechanic
User-agent: NICErsPRO
User-agent: Offline Explorer
User-agent: Openfind
User-agent: OpenindexSpider
User-agent: ProPowerBot/2.14
User-agent: ProWebWalker
User-agent: psbot
User-agent: QuepasaCreep
User-agent: QueryN Metasearch
User-agent: RepoMonkey
User-agent: RMA
User-agent: SightupBot
User-agent: SiteBot
User-agent: SiteSnagger
User-agent: SiteSucker
User-agent: Sogou web spider
User-agent: sosospider
User-agent: SpankBot
User-agent: spanner
User-agent: Speedy
User-agent: suggybot
User-agent: SuperBot
User-agent: SuperBot/2.6
User-agent: suzuran
User-agent: Szukacz/1.4
User-agent: Teleport
User-agent: Telesoft
User-agent: The Intraformant
User-agent: TheNomad
User-agent: TightTwatBot
User-agent: Titan
User-agent: toCrawl/UrlDispatcher
User-agent: TosCrawler
User-agent: trendictionbot
User-agent: True_Robot
User-agent: True_Robot/1.0
User-agent: turingos
User-agent: TurnitinBot
User-agent: UrlPouls
User-agent: URLy Warning
User-agent: VCI
User-agent: Web Image Collector
User-agent: WebAuto
User-agent: WebBandit
User-agent: WebBandit/3.50
User-agent: WebCopier
User-agent: webcopy
User-agent: WebEnhancer
User-agent: WebmasterWorldForumBot
User-agent: webmirror
User-agent: WebReaper
User-agent: WebSauger
User-agent: website extractor
User-agent: Website Quester
User-agent: Webster Pro
User-agent: WebStripper
User-agent: WebStripper/2.02
User-agent: WebZip
User-agent: wget
User-agent: WikioFeedBot
User-agent: WinHTTrack
User-agent: WWW-Collector-E
User-agent: Xenu Link Sleuth/1.3.8
User-agent: yacy
User-agent: yandex
User-agent: YRSPider
User-agent: Zeus
User-agent: Zookabot
User-agent: ABACHOBot
User-agent: Accoona-AI-Agent
User-agent: AddSugarSpiderBot
User-agent: AnyApexBot
User-agent: Arachmo
User-agent: B-l-i-t-z-B-O-T
User-agent: BecomeBot
User-agent: BeslistBot
User-agent: BillyBobBot
User-agent: Bimbot
User-agent: BlitzBOT
User-agent: boitho.com-dc
User-agent: boitho.com-robot
User-agent: btbot
User-agent: CatchBot
User-agent: Cerberian Drtrs
User-agent: Charlotte
User-agent: ConveraCrawler
User-agent: Covario IDS
User-agent: DataparkSearch
User-agent: DiamondBot
User-agent: Discobot
User-agent: EmeraldShield.com WebBot
User-agent: envolk[ITS]spider
User-agent: EsperanzaBot
User-agent: FAST Enterprise Crawler
User-agent: FAST-WebCrawler
User-agent: FDSE robot
User-agent: FindLinks
User-agent: FurlBot
User-agent: FyberSpider
User-agent: g2crawler
User-agent: Gaisbot
User-agent: GalaxyBot
User-agent: genieBot
User-agent: Gigabot
User-agent: Girafabot
User-agent: GurujiBot
User-agent: HappyFunBot
User-agent: hl_ftien_spider
User-agent: Holmes
User-agent: htdig
User-agent: iaskspider
User-agent: ia_archiver
User-agent: iCCrawler
User-agent: ichiro
User-agent: igdeSpyder
User-agent: IRLbot
User-agent: IssueCrawler
User-agent: Jaxified Bot
User-agent: Jyxobot
User-agent: KoepaBot
User-agent: L.webis
User-agent: LapozzBot
User-agent: Larbin
User-agent: LDSpider
User-agent: LexxeBot
User-agent: Linguee Bot
User-agent: lmspider
User-agent: mabontland
User-agent: magpie-crawler
User-agent: MJ12bot
User-agent: Mnogosearch
User-agent: mogimogi
User-agent: MojeekBot
User-agent: Moreoverbot
User-agent: Morning Paper
User-agent: MSRBot
User-agent: MVAClient
User-agent: mxbot
User-agent: NetResearchServer
User-agent: NetSeer Crawler
User-agent: NewsGator
User-agent: NG-Search
User-agent: nicebot
User-agent: noxtrumbot
User-agent: Nusearch Spider
User-agent: NutchCVS
User-agent: Nymesis
User-agent: obot
User-agent: oegp
User-agent: omgilibot
User-agent: OmniExplorer_Bot
User-agent: OOZBOT
User-agent: Orbiter
User-agent: PageBitesHyperBot
User-agent: Peew
User-agent: polybot
User-agent: Pompos
User-agent: PostPost
User-agent: PycURL
User-agent: Qseero
User-agent: Radian6
User-agent: RAMPyBot
User-agent: RufusBot
User-agent: SandCrawler
User-agent: SBIder
User-agent: ScoutJet
User-agent: Scrubby
User-agent: SearchSight
User-agent: Seekbot
User-agent: semanticdiscovery
User-agent: Sensis Web Crawler
User-agent: SEOChat::Bot
User-agent: SeznamBot
User-agent: Shim-Crawler
User-agent: ShopWiki
User-agent: Shoula robot
User-agent: silk
User-agent: Snappy
User-agent: sogou spider
User-agent: Speedy Spider
User-agent: Sqworm
User-agent: StackRambler
User-agent: SurveyBot
User-agent: SynooBot
User-agent: Teoma
User-agent: TerrawizBot
User-agent: TheSuBot
User-agent: Thumbnail.CZ robot
User-agent: TinEye
User-agent: truwoGPS
User-agent: TweetedTimes Bot
User-agent: TwengaBot
User-agent: updated
User-agent: Urlfilebot
User-agent: Vagabondo
User-agent: VoilaBot
User-agent: Vortex
User-agent: voyager
User-agent: VYU2
User-agent: webcollage
User-agent: Websquash.com
User-agent: wf84
User-agent: WoFindeIch Robot
User-agent: WomlpeFactory
User-agent: Xaldon_WebSpider
User-agent: Yahoo! Slurp China
User-agent: YandexBot
User-agent: YandexImages
User-agent: Yasaklibot
User-agent: Yeti
User-agent: YodaoBot
User-agent: yoogliFetchAgent
User-agent: YoudaoBot
User-agent: Zao
User-agent: Zealbot
User-agent: zspider
User-agent: ZyBorg
User-agent: 5emeRue
User-agent: 5erue
User-agent: adequat
User-agent: adequat-systems
User-agent: AhrefsBot
User-agent: AITCSRobot/1.1
User-agent: AmiSoftware
User-agent: Aqua_Products
User-agent: Arachnophilia
User-agent: archive-fr.com
User-agent: Ask n read
User-agent: asknread.com
User-agent: ASpider/0.09
User-agent: AtraxSolutions
User-agent: Augure
User-agent: auramundi
User-agent: AURESYS/1.0
User-agent: b2w/0.1
User-agent: BackDoorBot
User-agent: BackRub/.
User-agent: Bad Bots
User-agent: Big Brother
User-agent: Bizbot003
User-agent: BizBot04
User-agent: Black.Hole
User-agent: BlackWidow
User-agent: BlowFish
User-agent: Bookmark search tool
User-agent: BotRightHere
User-agent: BSpider/1.0 libwww-perl/0.40
User-agent: Bullseye
User-agent: CACTVS Chemistry Spider
User-agent: CamontSpider
User-agent: ccbot
User-agent: ChangeDetection
User-agent: Checkbot/x.xx LWP/5.x
User-agent: ChinaClaw
User-agent: Cliqzbot
User-agent: coexel
User-agent: combine/0.0
User-agent: conceptbot/0.3
User-agent: Copernic
User-agent: Corporama
User-agent: Custo
User-agent: CyberPatrol SiteCat Webbot
User-agent: CyberSpyder/2.1
User-agent: Daumoa
User-agent: Deweb/1.01
User-agent: Digimind
User-agent: DIIbot
User-agent: DISCo
User-agent: DISCo Pump 3.0
User-agent: DISCo Pump 3.2
User-agent: DISCoFinder
User-agent: DOC
User-agent: Download Demon
User-agent: Download Demon/3.2.0.8
User-agent: Download Demon/3.5.0.11
User-agent: Download Ninja
User-agent: dumbot
User-agent: eCatch
User-agent: eCatch/3.0
User-agent: EirGrabber
User-agent: ellisphere
User-agent: EnigmaBot
User-agent: Enterprise_Search
User-agent: Enterprise_Search/1.0
User-agent: explorersearch
User-agent: Express WebPictures
User-agent: Express WebPictures
User-agent: EyeNetIE
User-agent: FairAd Client
User-agent: FelixIDE/1.0
User-agent: Fetch
User-agent: fido/0.9 Harvest/1.4.pl2
User-agent: Fish-Search-Robot
User-agent: Flaming AttackBot
User-agent: FlashGet
User-agent: FlashGet WebWasher 3.2
User-agent: FlipboardProxy
User-agent: Freecrawl
User-agent: FreeFind
User-agent: FrontPage
User-agent: gcreep/1.0
User-agent: GetRight
User-agent: GetRight/2.11
User-agent: GetRight/3.1
User-agent: GetRight/3.2
User-agent: GetRight/3.3
User-agent: GetRight/3.3.3
User-agent: GetRight/3.3.4
User-agent: GetRight/4.0.0
User-agent: GetRight/4.1.0
User-agent: GetRight/4.1.1
User-agent: GetRight/4.1.2
User-agent: GetRight/4.2
User-agent: GetRight/4.2b
User-agent: GetRight/4.2c
User-agent: GetRight/4.3
User-agent: GetRight/4.5
User-agent: GetRight/4.5a
User-agent: GetRight/4.5b
User-agent: GetRight/4.5b1
User-agent: GetRight/4.5b2
User-agent: GetRight/4.5b3
User-agent: GetRight/4.5b6
User-agent: GetRight/4.5b7
User-agent: GetRight/4.5c
User-agent: GetRight/4.5d
User-agent: GetRight/4.5e
User-agent: GetRight/5.0beta1
User-agent: GetRight/5.0beta2
User-agent: GetRight/5c
User-agent: GetRight/5d
User-agent: GetRight/5e
User-agent: GetURL.rexx v1.05
User-agent: GetWeb!
User-agent: Go!Zilla
User-agent: Go!Zilla
User-agent: Go!Zilla 3.3
User-agent: Go!Zilla 3.5
User-agent: Go-Ahead-Got-It
User-agent: Golem/1.1
User-agent: GrabNet
User-agent: Grafula
User-agent: Gromit/1.0
User-agent: grub
User-agent: grub-client
User-agent: Harvest
User-agent: Hatena Antenna
User-agent: Hazel's Ferret Web hopper
User-agent: Heritrix
User-agent: Hmhkki/0.2
User-agent: HMView
User-agent: Httpful/0.2.20
User-agent: HTTrack [NC,OR]
User-agent: Huaweisymantecspider
User-agent: ia_archiver-web.archive.org
User-agent: Image Stripper
User-agent: Image Sucker
User-agent: inagist.com url crawler
User-agent: IncyWincy/1.0b1
User-agent: Indy Library
User-agent: Informant
User-agent: infoseek
User-agent: INGRID/0.1
User-agent: InterGET
User-agent: Internet Ninja
User-agent: Internet Ninja 4.0
User-agent: Internet Ninja 5.0
User-agent: Internet Ninja 6.0
User-agent: Iron33/1.0.2
User-agent: IsraeliSearch/1.0
User-agent: ITI Spider
User-agent: Jetbot
User-agent: Jetbot/1.0
User-agent: JetCar
User-agent: JOC Web Spider
User-agent: JubiiRobot
User-agent: jumpstation
User-agent: k2spider
User-agent: Katipo/1.0
User-agent: kbcrawl
User-agent: Kenjin.Spider
User-agent: Keyword Density/0.9
User-agent: Keyword.Density
User-agent: KIT-Fireball/2.0 libwww/5.0a
User-agent: Knowings
User-agent: LabelGrab/1.1
User-agent: larbin
User-agent: leadbox
User-agent: LeechFTP
User-agent: libwww
User-agent: linkfluence
User-agent: linklooker
User-agent: linko
User-agent: LinkScan/8.1a.Unix
User-agent: LNSpiderguy
User-agent: Mass Downloader
User-agent: Mass Downloader/2.2
User-agent: Mata.Hari
User-agent: MediaFox/x.y
User-agent: Meltwater
User-agent: MerzScope
User-agent: METAGOPHER
User-agent: Microsoft URL Control
User-agent: Microsoft.URL
User-agent: Microsoft.URL.Control
User-agent: MIDown tool
User-agent: Mister Pix II 2.01
User-agent: Mister Pix II 2.02a
User-agent: Mister PiX version.dll
User-agent: Mister.PiX
User-agent: MOMspider/1.00 libwww-perl/0.40
User-agent: Moreover
User-agent: Motor/0.2
User-agent: Mozilla/4.0 (compatible; BullsEye; Windows 95)
User-agent: MSIECrawler
User-agent: mytwip
User-agent: naver
User-agent: Navroad
User-agent: NearSite
User-agent: NeoScioCrawler
User-agent: Net Vampire
User-agent: Net Vampire/3.0
User-agent: NetAnts/1.10
User-agent: NetAnts/1.23
User-agent: NetAnts/1.24
User-agent: NetAnts/1.25
User-agent: NetAttache Light 1.1
User-agent: NetCarta CyberPilot Pro
User-agent: NetScoop/1.0 libwww/5.0a
User-agent: NetSpider
User-agent: NetZIP
User-agent: NetZip Downloader 1.0 Win32(Nov 12 1998)
User-agent: NetZip-Downloader/1.0.62 (Win32; Dec 7 1998)
User-agent: NetZippy+
User-agent: NewsNow
User-agent: Newzbin
User-agent: NHSEWalker/3.0
User-agent: NING/1.0
User-agent: Nomad-V2.x
User-agent: NPBot
User-agent: Nutch
User-agent: Occam/1.0
User-agent: Octopus
User-agent: Offline Explorer/1.2
User-agent: Offline Explorer/1.4
User-agent: Offline Explorer/1.6
User-agent: Offline Explorer/1.7
User-agent: Offline Explorer/1.9
User-agent: Offline Explorer/2.0
User-agent: Offline Explorer/2.1
User-agent: Offline Explorer/2.3
User-agent: Offline Explorer/2.4
User-agent: Offline Explorer/2.5
User-agent: Offline Navigator
User-agent: Offline.Explorer
User-agent: OGspider
User-agent: Open Text Site Crawler V1.0
User-agent: Openbot
User-agent: Openfind data gathere
User-agent: Openfind data gatherer
User-agent: opinion-tracker
User-agent: Oracle Ultra Search
User-agent: PageGrabber
User-agent: panscient.com
User-agent: Papa Foto
User-agent: pavuk
User-agent: pcBrowser
User-agent: PerMan
User-agent: PGP-KA/1.2
User-agent: proxem
User-agent: python-requests
User-agent: Python-urllib
User-agent: QueryN.Metasearch
User-agent: Qwam content intelligence
User-agent: R6_CommentReader
User-agent: R6_FeedFetcher
User-agent: Radiation Retriever 1.1
User-agent: readability.com
User-agent: RealDownload
User-agent: RealDownload/4.0.0.40
User-agent: RealDownload/4.0.0.41
User-agent: RealDownload/4.0.0.42
User-agent: ReGet
User-agent: RepoMonkey Bait & Tackle/v1.01
User-agent: Resume Robot
User-agent: rogerbot
User-agent: Roverbot
User-agent: SafetyNet Robot 0.1
User-agent: SapphireWebCrawler
User-agent: score3
User-agent: SearchmetricsBot
User-agent: searchpreview
User-agent: SemrushBot
User-agent: semvisuBot
User-agent: Senrigan/xxxxxx
User-agent: Sindup
User-agent: sitecheck.internetseer.com
User-agent: SlySearch
User-agent: SmartDownload
User-agent: SmartDownload/1.2.76
User-agent: SmartDownload/1.2.77
User-agent: SmartDownload/1.2.77
User-agent: SmartDownload/1.2.77
User-agent: Snooper/b97_01
User-agent: Solbot/1.0 LWP/5.07
User-agent: sootle
User-agent: Spanner/1.0 (Linux 2.0.27 i586)
User-agent: spbot
User-agent: spotter
User-agent: spotter
User-agent: spyder3.microsys.com
User-agent: Sqworm/2.9.85-BETA (beta_release; 20011115-775; i686-pc-linux
User-agent: Stanford
User-agent: Stanford Comp Sci
User-agent: SuperBot/3.0 (Win32)
User-agent: SuperBot/3.1 (Win32)
User-agent: SuperHTTP
User-agent: SuperHTTP/1.0
User-agent: Surfbot
User-agent: Synthesio
User-agent: tAkeOut
User-agent: Teleport Pro
User-agent: Teleport Pro/1.29
User-agent: Teleport Pro/1.29.1590
User-agent: Teleport Pro/1.29.1634
User-agent: Teleport Pro/1.29.1718
User-agent: Teleport Pro/1.29.1820
User-agent: Teleport Pro/1.29.1847
User-agent: TeleportPro
User-agent: The.Intraformant
User-agent: trendeo
User-agent: trendybuzz
User-agent: TurnitinBot/1.5
User-agent: twiceler
User-agent: UbiCrawler
User-agent: UCSD-Crawler
User-agent: UnisterBot
User-agent: UnwindFetchor/1.0
User-agent: Updownerbot
User-agent: URL Control
User-agent: URL_Spider_Pro
User-agent: urlck/1.2.3
User-agent: URLSpiderPro
User-agent: URLy.Warning
User-agent: Valkyrie/1.0 libwww-perl/0.40
User-agent: vBSEO
User-agent: VCI WebViewer VCI WebViewer Win32
User-agent: vecteurplus
User-agent: verticalsearch
User-agent: VoidEYE
User-agent: vsw
User-agent: Web Sucker
User-agent: Web.Image.Collector
User-agent: WebAuto/3.40 (Win98; I)
User-agent: WebCapture 2.0
User-agent: WebCopier v.2.2
User-agent: WebCopier v2.5
User-agent: WebCopier v2.6
User-agent: WebCopier v2.7a
User-agent: WebCopier v2.8
User-agent: WebCopier v3.0
User-agent: WebCopier v3.0.1
User-agent: WebCopier v3.2
User-agent: WebCopier v3.2a
User-agent: WebCopy/
User-agent: WebCrawler/3.0 Robot libwww/5.0a
User-agent: WebEMailExtrac.*
User-agent: WebFerret
User-agent: WebFetch
User-agent: webfetch/2.1.0
User-agent: WebFetcher/0.8,
User-agent: WebGo IS
User-agent: weblayers/0.0
User-agent: WebLeacher
User-agent: WebLinker/0.0 libwww-perl/0.1
User-agent: WebmasterWorld Extractor
User-agent: webmeupbot
User-agent: WebMoose/0.0.0000
User-agent: weborama-fetcher
User-agent: WebReaper v9.1
User-agent: WebReaper v9.7
User-agent: WebReaper v9.8
User-agent: WebReaper vWebReaper v7.3
User-agent: webs@recruit.co.jp
User-agent: WebSauger 1.20b
User-agent: WebSauger 1.20j
User-agent: WebSauger 1.20k
User-agent: Website Quester
User-agent: Webster.Pro
User-agent: WebStripper/2.03
User-agent: WebStripper/2.10
User-agent: WebStripper/2.12
User-agent: WebStripper/2.13
User-agent: WebStripper/2.15
User-agent: WebStripper/2.16
User-agent: WebStripper/2.19
User-agent: WebVac
User-agent: webvac/1.0
User-agent: webwalk
User-agent: WebWalker
User-agent: WebWalker/1.10
User-agent: WebWatch
User-agent: WebWhacker
User-agent: WebZIP/2.75
User-agent: WebZIP/3.65
User-agent: WebZIP/3.80
User-agent: WebZip/4.0
User-agent: WebZIP/4.0
User-agent: WebZIP/4.1
User-agent: WebZIP/4.21
User-agent: WebZIP/4.21
User-agent: WebZIP/5.0
User-agent: WebZIP/5.0
User-agent: WebZIP/5.0 PR1
User-agent: Wget/1.4.0
User-agent: Wget/1.5.2
User-agent: Wget/1.5.3
User-agent: Wget/1.6
User-agent: Wget/1.7
User-agent: Wget/1.8
User-agent: Wget/1.8.1
User-agent: Wget/1.8.1+cvs
User-agent: Wget/1.8.2
User-agent: Wget/1.9-beta
User-agent: WhoWhere Robot
User-agent: Widow
User-agent: wikiwix-bot-3.0
User-agent: winello
User-agent: wired-digital-newsbot/1.5
User-agent: WWW Collector
User-agent: WWWOFFLE
User-agent: WWWWanderer v3.0
User-agent: Xaldon WebSpider
User-agent: Xaldon WebSpider 2.5.b3
User-agent: Xenu
User-agent: Xenu's
User-agent: Xenu's Link Sleuth 1.1c
User-agent: XGET/0.7
User-agent: Yahoo Pipes 1.0
User-agent: Yahoo Pipes 2.0
User-agent: YandexSomething
User-agent: yes
User-agent: YesupBot
User-agent: Youmag
User-agent: Zeus 11389 Webster Pro V2.9 Win32
User-agent: Zeus 11652 Webster Pro V2.9 Win32
User-agent: Zeus 18018 Webster Pro V2.9 Win32
User-agent: Zeus 26378 Webster Pro V2.9 Win32
User-agent: Zeus 30747 Webster Pro V2.9 Win32
User-agent: Zeus 32297 Webster Pro V2.9 Win32
User-agent: Zeus 39206 Webster Pro V2.9 Win32
User-agent: Zeus 41641 Webster Pro V2.9 Win32
User-agent: Zeus 44238 Webster Pro V2.9 Win32
User-agent: Zeus 51070 Webster Pro V2.9 Win32
User-agent: Zeus 51674 Webster Pro V2.9 Win32
User-agent: Zeus 51837 Webster Pro V2.9 Win32
User-agent: Zeus 63567 Webster Pro V2.9 Win32
User-agent: Zeus 6694 Webster Pro V2.9 Win32
User-agent: Zeus 82016 Webster Pro V2.9 Win32
User-agent: Zeus 82900 Webster Pro V2.9 Win32
User-agent: Zeus 84842 Webster Pro V2.9 Win32
User-agent: Zeus 90872 Webster Pro V2.9 Win32
User-agent: Zeus 94934 Webster Pro V2.9 Win32
User-agent: Zeus 95245 Webster Pro V2.9 Win32
User-agent: Zeus 95351 Webster Pro V2.9 Win32
User-agent: Zeus 97371 Webster Pro V2.9 Win32
User-agent: Zeus Link Scout
User-agent: Zite
User-agent: SemrushBot
User-agent: SemrushBot-SA
Disallow: /