User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php ## Do not crawl these dynamic links Disallow: /*?eventDisplay= Disallow: /*?tribe-bar-date= Disallow: /*?ical= Disallow: /*?_escaped_fragment_= ### Allowed Bots ################################## ################################################### ### Updated: Thurs 26 Jan 2023 ################################################### ### Google ######################################## User-agent: Googlebot Crawl-delay: 20 User-agent: APIs-Google Crawl-delay: 20 User-agent: AdsBot-Google-Mobile Crawl-delay: 20 User-agent: AdsBot-Google-Mobile Crawl-delay: 20 User-agent: AdsBot-Google Crawl-delay: 20 User-agent: Mediapartners-Google Crawl-delay: 20 User-agent: Googlebot-Image Crawl-delay: 20 User-agent: Googlebot-News Crawl-delay: 20 User-agent: Googlebot-Video Crawl-delay: 20 User-agent: Storebot-Googlebot Crawl-delay: 20 User-agent: Google-Site-Verification Crawl-delay: 20 ### End Google #################################### ### Bing ########################################## User-agent: Bingbot Crawl-delay: 20 User-agent: AdIdxBot Crawl-delay: 20 User-agent: BingPreview Crawl-delay: 20 User-agent: MicrosoftPreview Crawl-delay: 20 ### END Bing ###################################### ### Yahoo ######################################### User-agent: Slurp Crawl-delay: 20 ### END Yahoo ##################################### ### DuckDuckGo #################################### User-agent: DuckDuckBot Crawl-delay: 20 ### END DuckDuckGo ################################ ### Baidu ######################################### User-agent: Baiduspider Crawl-delay: 20 ### END Baidu ##################################### ### Yandex ######################################### User-agent: YandexBot Crawl-delay: 20 ### END Yandex ##################################### ### ExaLead ######################################### User-agent: ExaBot Crawl-delay: 20 ### END Exalead ##################################### ### Facebook ######################################### User-agent: facebot Crawl-delay: 20 ### END Facebook ##################################### ### Applebot ######################################### User-agent: Applebot Crawl-delay: 20 ### END Applebot ##################################### ### MOZ ########################################### User-agent: rogerbot Crawl-delay: 20 User-agent: dotbot Crawl-delay: 20 ### END MOZ ####################################### ### SEMrush ####################################### User-agent: SemrushBot Crawl-delay: 20 User-agent: SiteAuditBot Crawl-delay: 20 User-agent: SemrushBot-BA Crawl-delay: 20 User-agent: SemrushBot-SI Crawl-delay: 20 User-agent: SemrushBot-SWA Crawl-delay: 20 User-agent: SemrushBot-CT Crawl-delay: 20 User-agent: SplitSignalBot Crawl-delay: 20 User-agent: SemrushBot-COUB Crawl-delay: 20 ### END SEMrush ################################# ### ahrefs ###################################### User-agent: AhrefsBot Crawl-delay: 20 ### END ahrefs ################################## ### Majestic Bot ################################ User-agent: MJ12bot Crawl-delay: 20 ### END Majestic Bot ############################ ### Screaming Frog ############################## User-agent: Screaming Frog SEO Spider Crawl-delay: 20 ### END Screaming Frog ########################## ### END Allowed Bots ############################ ### Bad Bot Blocker ############################# ################################################# ### Updated: Thurs 26 Jan 2023 ################################################# User-agent: * Disallow: /wp-admin/ Allow: /wp-admin/admin-ajax.php User-agent: 01h4x.com Disallow:/ User-agent: 360Spider Disallow:/ User-agent: 404checker Disallow:/ User-agent: 404enemy Disallow:/ User-agent: 80legs Disallow:/ User-agent: ADmantX Disallow:/ User-agent: AIBOT Disallow:/ User-agent: ALittle Client Disallow:/ User-agent: ASPSeek Disallow:/ User-agent: Abonti Disallow:/ User-agent: Aboundex Disallow:/ User-agent: Aboundexbot Disallow:/ User-agent: Acunetix Disallow:/ User-agent: AfD-Verbotsverfahren Disallow:/ User-agent: AiHitBot Disallow:/ User-agent: Aipbot Disallow:/ User-agent: Alexibot Disallow:/ User-agent: AllSubmitter Disallow:/ User-agent: Alligator Disallow:/ User-agent: AlphaBot Disallow:/ User-agent: Anarchie Disallow:/ User-agent: Anarchy Disallow:/ User-agent: Anarchy99 Disallow:/ User-agent: Ankit Disallow:/ User-agent: Anthill Disallow:/ User-agent: Apexoo Disallow:/ User-agent: Aspiegel Disallow:/ User-agent: Asterias Disallow:/ User-agent: Atomseobot Disallow:/ User-agent: Attach Disallow:/ User-agent: AwarioRssBot Disallow:/ User-agent: AwarioSmartBot Disallow:/ User-agent: BBBike Disallow:/ User-agent: BDCbot Disallow:/ User-agent: BDFetch Disallow:/ User-agent: BLEXBot Disallow:/ User-agent: BackDoorBot Disallow:/ User-agent: BackStreet Disallow:/ User-agent: BackWeb Disallow:/ User-agent: Backlink-Ceck Disallow:/ User-agent: BacklinkCrawler Disallow:/ User-agent: Badass Disallow:/ User-agent: Bandit Disallow:/ User-agent: Barkrowler Disallow:/ User-agent: BatchFTP Disallow:/ User-agent: Battleztar Bazinga Disallow:/ User-agent: BetaBot Disallow:/ User-agent: Bigfoot Disallow:/ User-agent: Bitacle Disallow:/ User-agent: Black Hole Disallow:/ User-agent: BlackWidow Disallow:/ User-agent: Blackboard Disallow:/ User-agent: Blow Disallow:/ User-agent: BlowFish Disallow:/ User-agent: Boardreader Disallow:/ User-agent: Bolt Disallow:/ User-agent: BotALot Disallow:/ User-agent: Brandprotect Disallow:/ User-agent: Brandwatch Disallow:/ User-agent: Buck Disallow:/ User-agent: Buddy Disallow:/ User-agent: BuiltBotTough Disallow:/ User-agent: BuiltWith Disallow:/ User-agent: Bullseye Disallow:/ User-agent: BunnySlippers Disallow:/ User-agent: BuzzSumo Disallow:/ User-agent: CATExplorador Disallow:/ User-agent: CCBot Disallow:/ User-agent: CODE87 Disallow:/ User-agent: CSHttp Disallow:/ User-agent: Calculon Disallow:/ User-agent: CazoodleBot Disallow:/ User-agent: Cegbfeieh Disallow:/ User-agent: CensysInspect Disallow:/ User-agent: CheTeam Disallow:/ User-agent: CheeseBot Disallow:/ User-agent: CherryPicker Disallow:/ User-agent: ChinaClaw Disallow:/ User-agent: Chlooe Disallow:/ User-agent: Citoid Disallow:/ User-agent: Claritybot Disallow:/ User-agent: Cliqzbot Disallow:/ User-agent: Cloud mapping Disallow:/ User-agent: Cocolyzebot Disallow:/ User-agent: Cogentbot Disallow:/ User-agent: Collector Disallow:/ User-agent: Copier Disallow:/ User-agent: CopyRightCheck Disallow:/ User-agent: Copyscape Disallow:/ User-agent: Cosmos Disallow:/ User-agent: Craftbot Disallow:/ User-agent: Crawling at Home Project Disallow:/ User-agent: CrazyWebCrawler Disallow:/ User-agent: Crescent Disallow:/ User-agent: CrunchBot Disallow:/ User-agent: Curious Disallow:/ User-agent: Custo Disallow:/ User-agent: CyotekWebCopy Disallow:/ User-agent: DBLBot Disallow:/ User-agent: DIIbot Disallow:/ User-agent: DSearch Disallow:/ User-agent: DTS Agent Disallow:/ User-agent: DataCha0s Disallow:/ User-agent: DatabaseDriverMysqli Disallow:/ User-agent: Demon Disallow:/ User-agent: Deusu Disallow:/ User-agent: Devil Disallow:/ User-agent: Digincore Disallow:/ User-agent: DigitalPebble Disallow:/ User-agent: Dirbuster Disallow:/ User-agent: Disco Disallow:/ User-agent: Discobot Disallow:/ User-agent: Discoverybot Disallow:/ User-agent: Dispatch Disallow:/ User-agent: DittoSpyder Disallow:/ User-agent: DnBCrawler-Analytics Disallow:/ User-agent: DnyzBot Disallow:/ User-agent: DomCopBot Disallow:/ User-agent: DomainAppender Disallow:/ User-agent: DomainCrawler Disallow:/ User-agent: DomainSigmaCrawler Disallow:/ User-agent: DomainStatsBot Disallow:/ User-agent: Domains Project Disallow:/ User-agent: Download Wonder Disallow:/ User-agent: Dragonfly Disallow:/ User-agent: Drip Disallow:/ User-agent: ECCP/1.0 Disallow:/ User-agent: EMail Siphon Disallow:/ User-agent: EMail Wolf Disallow:/ User-agent: EasyDL Disallow:/ User-agent: Ebingbong Disallow:/ User-agent: Ecxi Disallow:/ User-agent: EirGrabber Disallow:/ User-agent: EroCrawler Disallow:/ User-agent: Evil Disallow:/ User-agent: Express WebPictures Disallow:/ User-agent: ExtLinksBot Disallow:/ User-agent: Extractor Disallow:/ User-agent: ExtractorPro Disallow:/ User-agent: Extreme Picture Finder Disallow:/ User-agent: EyeNetIE Disallow:/ User-agent: Ezooms Disallow:/ User-agent: FDM Disallow:/ User-agent: FHscan Disallow:/ User-agent: FemtosearchBot Disallow:/ User-agent: Fimap Disallow:/ User-agent: Firefox/7.0 Disallow:/ User-agent: FlashGet Disallow:/ User-agent: Flunky Disallow:/ User-agent: Foobot Disallow:/ User-agent: Freeuploader Disallow:/ User-agent: FrontPage Disallow:/ User-agent: Fuzz Disallow:/ User-agent: FyberSpider Disallow:/ User-agent: Fyrebot Disallow:/ User-agent: G-i-g-a-b-o-t Disallow:/ User-agent: GT::WWW Disallow:/ User-agent: GalaxyBot Disallow:/ User-agent: Genieo Disallow:/ User-agent: GermCrawler Disallow:/ User-agent: GetRight Disallow:/ User-agent: GetWeb Disallow:/ User-agent: Getintent Disallow:/ User-agent: Gigabot Disallow:/ User-agent: Go!Zilla Disallow:/ User-agent: Go-Ahead-Got-It Disallow:/ User-agent: GoZilla Disallow:/ User-agent: Gotit Disallow:/ User-agent: GrabNet Disallow:/ User-agent: Grabber Disallow:/ User-agent: Grafula Disallow:/ User-agent: GrapeFX Disallow:/ User-agent: GrapeshotCrawler Disallow:/ User-agent: GridBot Disallow:/ User-agent: HEADMasterSEO Disallow:/ User-agent: HMView Disallow:/ User-agent: HTMLparser Disallow:/ User-agent: HTTP::Lite Disallow:/ User-agent: HTTrack Disallow:/ User-agent: Haansoft Disallow:/ User-agent: HaosouSpider Disallow:/ User-agent: Harvest Disallow:/ User-agent: Havij Disallow:/ User-agent: Heritrix Disallow:/ User-agent: Hloader Disallow:/ User-agent: HonoluluBot Disallow:/ User-agent: Humanlinks Disallow:/ User-agent: HybridBot Disallow:/ User-agent: IDBTE4M Disallow:/ User-agent: IDBot Disallow:/ User-agent: IRLbot Disallow:/ User-agent: Iblog Disallow:/ User-agent: Id-search Disallow:/ User-agent: IlseBot Disallow:/ User-agent: Image Fetch Disallow:/ User-agent: Image Sucker Disallow:/ User-agent: IndeedBot Disallow:/ User-agent: Indy Library Disallow:/ User-agent: InfoNaviRobot Disallow:/ User-agent: InfoTekies Disallow:/ User-agent: Intelliseek Disallow:/ User-agent: InterGET Disallow:/ User-agent: Internet Ninja Disallow:/ User-agent: InternetSeer Disallow:/ User-agent: Iria Disallow:/ User-agent: Iskanie Disallow:/ User-agent: IstellaBot Disallow:/ User-agent: JOC Web Spider Disallow:/ User-agent: JamesBOT Disallow:/ User-agent: Jbrofuzz Disallow:/ User-agent: JennyBot Disallow:/ User-agent: JetCar Disallow:/ User-agent: Jetty Disallow:/ User-agent: JikeSpider Disallow:/ User-agent: Joomla Disallow:/ User-agent: Jorgee Disallow:/ User-agent: JustView Disallow:/ User-agent: Jyxobot Disallow:/ User-agent: Kenjin Spider Disallow:/ User-agent: Keybot Translation-Search-Machine Disallow:/ User-agent: Keyword Density Disallow:/ User-agent: Kinza Disallow:/ User-agent: Kozmosbot Disallow:/ User-agent: LNSpiderguy Disallow:/ User-agent: LWP::Simple Disallow:/ User-agent: Lanshanbot Disallow:/ User-agent: Larbin Disallow:/ User-agent: Leap Disallow:/ User-agent: LeechFTP Disallow:/ User-agent: LeechGet Disallow:/ User-agent: LexiBot Disallow:/ User-agent: Lftp Disallow:/ User-agent: LibWeb Disallow:/ User-agent: Libwhisker Disallow:/ User-agent: LieBaoFast Disallow:/ User-agent: Lightspeedsystems Disallow:/ User-agent: Likse Disallow:/ User-agent: LinkScan Disallow:/ User-agent: LinkWalker Disallow:/ User-agent: Linkbot Disallow:/ User-agent: LinkextractorPro Disallow:/ User-agent: LinkpadBot Disallow:/ User-agent: LinksManager Disallow:/ User-agent: LinqiaMetadataDownloaderBot Disallow:/ User-agent: LinqiaRSSBot Disallow:/ User-agent: LinqiaScrapeBot Disallow:/ User-agent: Lipperhey Disallow:/ User-agent: Lipperhey Spider Disallow:/ User-agent: Litemage_walker Disallow:/ User-agent: Lmspider Disallow:/ User-agent: Ltx71 Disallow:/ User-agent: MFC_Tear_Sample Disallow:/ User-agent: MIDown tool Disallow:/ User-agent: MIIxpc Disallow:/ User-agent: MQQBrowser Disallow:/ User-agent: MSFrontPage Disallow:/ User-agent: MSIECrawler Disallow:/ User-agent: MTRobot Disallow:/ User-agent: Mag-Net Disallow:/ User-agent: Magnet Disallow:/ User-agent: Mail.RU_Bot Disallow:/ User-agent: Majestic SEO Disallow:/ User-agent: Majestic-SEO Disallow:/ User-agent: Majestic12 Disallow:/ User-agent: MarkMonitor Disallow:/ User-agent: MarkWatch Disallow:/ User-agent: Mass Downloader Disallow:/ User-agent: Masscan Disallow:/ User-agent: Mata Hari Disallow:/ User-agent: MauiBot Disallow:/ User-agent: Mb2345Browser Disallow:/ User-agent: MeanPath Bot Disallow:/ User-agent: Meanpathbot Disallow:/ User-agent: Mediatoolkitbot Disallow:/ User-agent: MegaIndex.ru Disallow:/ User-agent: Metauri Disallow:/ User-agent: MicroMessenger Disallow:/ User-agent: Microsoft Data Access Disallow:/ User-agent: Microsoft URL Control Disallow:/ User-agent: Minefield Disallow:/ User-agen...