宝塔UA爬虫黑名单
宝塔waf防火墙 导入即可
Go-http-client
Python
Java
Python-urllib
Alexa Toolbar
hubspot
my-tiny-bot
eiki
MegaIndex.ru
ImagesiftBot
DuckDuckGo-Favicons-Bot
InfoTigerBot
JikeSpider
Ezooms
serpstatbot
BLEXBot
Html5plus
heritrix
DigExt
YYSpider
lightDeckReports Bot
jaunty
oBot
ZmEu
Swiftbot
Microsoft URL Control
ApacheBench
UniversalFeedParser
Feedly
Barkrowler
CoolpadWebkit
CrawlDaddy
AskTbFXTV
Indy Library
FeedDemon
coccocbot
intelx.io
ds-robot
MauiBot
ExtLinksBot
webmeup
Konturbot
VelenPublicWebCrawler
Amazonbot
ZoominfoBot
DotBot
MJ12bot
SemrushBot
AhrefsBot
CCBot
Claude
ClaudeBot
GPTBot
如果影响采集 可以移除下面的
Java
Python
Python-urllib
Go-http-client