百度已收录
并非所有机器人都是坏的
并非所有机器人都是坏的。Cloudflare 维护着一份“经过验证”的良好机器人列表。
经过验证的机器人，例如来自搜索引擎的机器人，通常对其身份是透明的。Cloudflare 手动批准行为良好的服务，这些服务有利于更广泛的互联网并尊重 robots.txt。
| Rank | Name | Owner | Category |
|---|---|---|---|
| 1 | GoogleBot | Search Engine Crawler | |
| 2 | Qualys | Qualys | Security |
| 3 | BingBot | Microsoft | Search Engine Crawler |
| 4 | DataDog Syntheric Bot | DataDog | Monitoring & Analytics |
| 5 | Google AdsBot | Advertising & Marketing | |
| 6 | YandexBot | Yandex | Search Engine Crawler |
| 7 | AhrefsBot | Ahrefs | Search Engine Optimization |
| 8 | Google Image Proxy | Page Preview | |
| 9 | Google Images | Search Engine Crawler | |
| 10 | PetalBot | Huawei | Search Engine Crawler |
| 11 | Amazonbot | Amazon | Accessibility |
| 12 | Google API | Webhooks | |
| 13 | New Relic | New Relic | Monitoring & Analytics |
| 14 | UptimeRobot | Uptimerobot | Other |
| 15 | Applebot | Apple | Search Engine Crawler |
| 16 | Detectify | Detectify | Security |
| 17 | Moz dotbot | Moz | Search Engine Optimization |
| 18 | PinterestBot | Social Media Marketing | |
| 19 | SendGrid | SendGrid | Webhooks |
| 20 | GPTBot | OpenAI | Other |
| 21 | Botify | Botify | Search Engine Optimization |
| 22 | Google Feed Fetcher | Feed Fetcher | |
| 23 | Google Read Aloud | Accessibility | |
| 24 | Google AdSense | Advertising & Marketing | |
| 25 | Baidu | Baidu | Search Engine Crawler |
| 26 | Pingdom | Pingdom | Monitoring & Analytics |
| 27 | Proximic | ComScore | Monitoring & Analytics |
| 28 | Sogou | Sogou | Search Engine Crawler |
| 29 | Ahrefs Site Audit | Ahrefs | Search Engine Optimization |
| 30 | CriteoBot | Criteo | Advertising & Marketing |
| 31 | Site24x7 | Site24x7 | Monitoring & Analytics |
| 32 | BLEXBot | WebMeUp | Search Engine Optimization |
| 33 | Seekport | SISTRIX | Search Engine Crawler |
| 34 | YahooMailProxy | Yahoo | Page Preview |
| 35 | ContentKing | ContentKing | Monitoring & Analytics |
| 36 | Sucuri | Sucuri | Security |
| 37 | Slackbot | Slack | Social Media Marketing |
| 38 | SEMrush | SEMrush | Search Engine Optimization |
| 39 | Grapeshot | Grapeshot | Advertising & Marketing |
| 40 | Stripe | Stripe | Webhooks |
| 41 | SiteAuditBot | Semrush | Search Engine Optimization |
| 42 | Better Uptime | Better Up Time | Monitoring & Analytics |
| 43 | DataForSEO Bot | DataForSEO | Advertising & Marketing |
| 44 | Barkrowler | Babbar | Search Engine Optimization |
| 45 | elmah.io Uptime Monitoring | elmah.io | Monitoring & Analytics |
| 46 | Bing Ads | Microsoft | Advertising & Marketing |
| 47 | StatusCake | StatusCake | Monitoring & Analytics |
| 48 | Brandwatch | Brandwatch | Social Media Marketing |
| 49 | HetrixTools | HetrixTools Inc | Monitoring & Analytics |
| 50 | Cốc Cốc | Coccoc | Search Engine Crawler |
| 51 | Rackspace | Rackspace | Monitoring & Analytics |
| 52 | FullStory | Full Story | Monitoring & Analytics |
| 53 | Siteimprove Crawl | Siteimprove | Other |
| 54 | Amazon AdBot | Amazon | Advertising & Marketing |
| 55 | Cookiebot | Cybot A/S | Other |
| 56 | Trendiction Bot | Trendiction S.A. | Monitoring & Analytics |
| 57 | Yeti by Naver | Naver | Search Engine Crawler |
| 58 | Qwant | Qwant | Search Engine Crawler |
| 59 | Freshping | freshworks | Monitoring & Analytics |
| 60 | DuckDuckBot | DuckDuckGo | Search Engine Crawler |
| 61 | ZoomInfo | ZoomInfo | Advertising & Marketing |
| 62 | Feedly | Feedly | Feed Fetcher |
| 63 | Parse.ly | Parse.ly | Monitoring & Analytics |
| 64 | Yahoo Ad Monitoring | Yahoo | Advertising & Marketing |
| 65 | ManageWP | ManageWP | Monitoring & Analytics |
| 66 | GoogleOther | Other | |
| 67 | BlogVault | BlogVault | Monitoring & Analytics |
| 68 | Cxense | Cxense | Search Engine Optimization |
| 69 | Ghost Inspector | Ghost Inspector | Monitoring & Analytics |
| 70 | Telegram Bot | Telegram | Page Preview |
| 71 | Yahoo Slurp | Yahoo | Search Engine Crawler |
| 72 | Internet Archive | Internet Archive | Academic Research |
| 73 | SiteLock | SiteLock | Security |
| 74 | Clickagy | Clickagy | Monitoring & Analytics |
| 75 | Adyen | Adyen | Webhooks |
| 76 | VaultPress | VaultPress | Security |
| 77 | Google Videos | Search Engine Crawler | |
| 78 | LinkedInBot | Search Engine Crawler | |
| 79 | EzoicBot | Ezoic Inc | Search Engine Optimization |
| 80 | Splunk | Splunk | Monitoring & Analytics |
| 81 | Outbrain | Outbrain | Advertising & Marketing |
| 82 | Coveo Bot | Coveo | Search Engine Crawler |
| 83 | Moz rogerbot | Moz | Search Engine Optimization |
| 84 | Let’s Encrypt | Let’s Encrypt | Other |
| 85 | Skype | Skype | Page Preview |
| 86 | Slack Image Proxy | Slack | Page Preview |
| 87 | Innologica | Innologica | Feed Fetcher |
| 88 | klaviyo | https://www.klaviyo.com/ | Advertising & Marketing |
| 89 | DataForSEO | DataForSEO | Search Engine Optimization |
| 90 | Nodeping | Nodeping | Monitoring & Analytics |
| 91 | GTmetrix | GTmetrix | Page Preview |
| 92 | Mojeek | Mojeek | Search Engine Crawler |
| 93 | Integromat | Make | Other |
| 94 | ChargeBee | ChargeBee | Webhooks |
| 95 | Alertsite by Smartbear | Smartbear | Monitoring & Analytics |
| 96 | Feeder | Really Simple AB | Feed Fetcher |
| 97 | MSN | Microsoft | Search Engine Crawler |
| 98 | Oh Dear | Oh Dear | Monitoring & Analytics |
| 99 | Google Inspection Tool | Security | |
| 100 | Uptimia | Uptimia | Monitoring & Analytics |
| 101 | Iframely | Iframely | Page Preview |
| 102 | PayPal | PayPal | Webhooks |
| 103 | Mars Finder | Mars Flag | Search Engine Crawler |
| 104 | Seznam | Seznam | Search Engine Crawler |
| 105 | Google Schema Markup Testing Tool | Monitoring & Analytics | |
| 106 | Automaton | Automaton | Monitoring & Analytics |
| 107 | Exodus | Exodus | Accessibility |
| 108 | HostTracker | HostTracker | Monitoring & Analytics |
| 109 | Awario | Awario | Search Engine Crawler |
| 110 | Marginalia Search | Marginalia | Search Engine Crawler |
| 111 | Taboola | Taboola | Advertising & Marketing |
| 112 | Feedbin | Feedbin | Feed Fetcher |
| 113 | InternetArchiveBot | Internet Archive | Page Preview |
| 114 | Audisto Crawler | Audisto | Monitoring & Analytics |
| 115 | Metorik | Metorik | Monitoring & Analytics |
| 116 | Bing Preview | Microsoft | Page Preview |
| 117 | SalesViewerBot | SalesViewer GmbH | Page Preview |
| 118 | EasyCron | EasyCron | Other |
| 119 | eMoney Advisor | eMoney Advisor | Other |
| 120 | Cludo | Cludo | Search Engine Crawler |
| 121 | rss2tg_bot | rss2tg_bot | Monitoring & Analytics |
| 122 | IAS crawler | Integral Ad Science | Advertising & Marketing |
| 123 | deadlinkchecker | DLC Websites | Monitoring & Analytics |
| 124 | NewsBlur | NewsBlur | Feed Fetcher |
| 125 | Quantcastbot | Quantcast | Other |
| 126 | Drata Autopilot | Monitoring & Analytics | |
| 127 | Skroutz ImageBot | Skroutz S.A. | Other |
| 128 | MonitoRSS | MonitoRSS | Feed Fetcher |
| 129 | SemrushBotSI | SEMrush | Search Engine Optimization |
| 130 | upday | upday GmbH & Co. KG | Search Engine Crawler |
| 131 | Amazon Contxbot | Amazon | Advertising & Marketing |
| 132 | Google Trust Services (DCV Check) | Security | |
| 133 | MediaMonitoringBot | MediaMonitoringBot | Search Engine Crawler |
| 134 | Accessible Web Bot | Accessible Web | Monitoring & Analytics |
| 135 | PressEngine Bot | PressEngine | Page Preview |
| 136 | Dr. Link Check | Dr. Link Check | Monitoring & Analytics |
| 137 | Jagged Pixel UptimeBot | Jagged Pixel Inc. | Monitoring & Analytics |
| 138 | ProjectShield Url Check | Security | |
| 139 | Spark Shipping | Spark Shipping | Other |
| 140 | Medialogia Bot | Medialogia | Monitoring & Analytics |
| 141 | Bluesky Link Preview Service | Bluesky | Page Preview |
| 142 | Reelevant | Reelevant | Advertising & Marketing |
| 143 | Watchful | Watchful LLC | Monitoring & Analytics |
| 144 | RSS API | RSS API (by Tibush GmbH) | Feed Fetcher |
| 145 | SkroutzBot | Skroutz S.A. | Feed Fetcher |
| 146 | Ozon Web Grabber | Ozon | Page Preview |
| 147 | Cert Chief | Chief Tools | Security |
| 148 | Jetpack | Automattic | Monitoring & Analytics |
| 149 | FeedWind Crawler | Mikle | Feed Fetcher |
| 150 | Nooshub | Nooshub | Feed Fetcher |
| 151 | Modular DS | Uniqoders Technologies SL | Monitoring & Analytics |
| 152 | Shortwave Image Fetcher | Shortwave Communications Inc. | Search Engine Crawler |
| 153 | Google Scholar | Search Engine Crawler | |
| 154 | Sentry | Sentry | Security |
| 155 | MgidBot | MGID | Advertising & Marketing |
| 156 | SecurityHeaders | Security Headers | Security |
| 157 | EvoUptimeBot | Evo Agency Ltd. | Monitoring & Analytics |
| 158 | SemrushBotSwa | SEMrush | Page Preview |
| 159 | videootv Bot | Digital Green | Advertising & Marketing |
| 160 | Swifteq Link Checker | Swfiteq Ltd | Security |
| 161 | WP Umbrella | WP Umbrella | Other |
| 162 | Notabot | Helpfeel | Search Engine Crawler |
| 163 | prerender | Prerender, LLC | Search Engine Optimization |
| 164 | eRepublik.tools | Sebastian Foth – Software Solutions | Monitoring & Analytics |
| 165 | RetroListeCOM | Niclas Papst | Monitoring & Analytics |
| 166 | WebSpiderMount | AspenTechLabs Inc | Advertising & Marketing |
| 167 | SMTnet PM Bot | SMTnet | Search Engine Crawler |
| 168 | Blockaid | Blockaid | Security |
| 169 | Missinglettr Bot | Missinglettr | Search Engine Crawler |
| 170 | Readable | Added Bytes Ltd | Monitoring & Analytics |
| 171 | MainWP | Direct Support / Website Managed | Monitoring & Analytics |
| 172 | HoneybadgerBot | Honeybadger Industries | Monitoring & Analytics |
机器人按请求数量排名。使用搜索来查询列表。
© 版权声明
文章版权归作者所有，未经允许请勿转载。
用微信 OR 支付宝 扫描二维码
为本文作者 打个赏
金额随意 快来“打”我呀～
相关文章
暂无评论...
今天仅剩
100%
本周还有
100%
本月剩余
100%
今年还剩
100%
