ai爬虫太要命了！屏蔽AI爬虫数据采集爬虫优化版
现在的ai爬虫太要命了！天天在服务器上乱爬，导致服务器都要爆了！
# 百度文心/千帆 | 阿里通义 | 字节豆包/扣子 | Kimi(月之暗面) | 智谱GLM | DeepSeek | 讯飞星火
baidusparkbot|baidu-yunguan|baiduai|tongyi-ai|qwenbot|doubao|coze|moonshot|zhipuai|chatglm|deepseek|sparkbot
# 腾讯元宝/搜狗 | 360 | 天工(昆仑万维) | 秘塔 | 阶跃星辰 | MiniMax(海螺) | 零一万物 | 华为盘古
yuanbao|yisouspider|sogou|360spider|tiangong|metaso|stepfun|minimaxbot|yibot|pangu
# ========== 屏蔽 AI / 数据采集爬虫 优化版 ==========
if ($http_user_agent ~* "(gptbot|oai-searchbot|chatgpt-user|openai|claudebot|claude-web|anthropic-ai|ccbot|perplexitybot|perplexity-user|bytespider|cohere-ai|amazonbot|meta-externalagent|applebot-extended|google-extended|googleother|diffbot|imagesiftbot|timpibot|tineye-bot|magpie-crawler|omgili|aihitbot|blexbot|dataforseobot|piplbot|mj12bot|petalbot|barkrowler|seokicks|dotbot|semrushbot|ahrefsbot|baidusparkbot|baiduyunguance|baiduai|tongyi-ai|qwenbot|doubaobot|coze|moonshotbot|moonshot|zhipuai|chatglm|deepseekbot|deepseekcrawler|sparkbot|yuanbaobot|tiangong|metaso|stepbot|minimaxbot|yibot|pangu|python-requests|python-urllib|scrapy|curl/|wget|go-http-client|httpx|okhttp|jsoup|libwww-perl|winhttprequest|node-fetch|axios|apache-httpclient|java/[0-9])") {
return 403;
}
# ========== 屏蔽结束 ==========
宝塔面板-Nginx-网站-配置文件-加入上面的代码，在所有location的上面：
只屏蔽国内 AI/大模型 爬虫，保留搜索引擎蜘蛛（Baiduspider、Sogou、360Spider、YisouSpider 等均不受影响）
说明：
用精确名称匹配，避免 sogou、360spider、yisouspider、baiduspider 等搜索蜘蛛被子串误伤。
仅屏蔽百度文心（baidusparkbot）、阿里通义（tongyi-ai/qwenbot）、豆包、Kimi、智谱、DeepSeek、讯飞星火、腾讯元宝、天工、秘塔等 AI 爬虫。