# robots.txt · 关投强(aigtq.com) # 站点:https://www.aigtq.com/ # 说明:放行搜索引擎与各大 AI 爬虫,确保内容可被抓取、可被引用。 # ---------- 通用爬虫 ---------- User-agent: * Allow: / Disallow: /admin/ Disallow: /api/ Disallow: /*?*utm_ Disallow: /*?*sessionid= # ---------- 国内大模型 / AI 搜索爬虫 · 显式放行 ---------- # 字节跳动(豆包 / 抖音搜索) User-agent: Bytespider Allow: / User-agent: DoubaoBot Allow: / # 阿里(通义千问) User-agent: QwenBot Allow: / User-agent: Qwen-Web Allow: / User-agent: AlibabaBot Allow: / # 百度(文心一言 / 百度搜索) User-agent: Baiduspider Allow: / User-agent: Baiduspider-render Allow: / User-agent: ErnieBot Allow: / # 腾讯(元宝 / 混元) User-agent: YuanbaoBot Allow: / User-agent: HunyuanBot Allow: / User-agent: Sosospider Allow: / # 月之暗面(Kimi) User-agent: KimiBot Allow: / User-agent: Kimi-SearchBot Allow: / User-agent: Kimi-User Allow: / # 智谱(GLM) User-agent: ChatGLM-Spider Allow: / # DeepSeek(经 Common Crawl 与搜索引擎获取) User-agent: DeepSeekBot Allow: / # ---------- 海外 AI 爬虫 · 显式放行 ---------- User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-SearchBot Allow: / User-agent: Claude-User Allow: / User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / User-agent: CCBot Allow: / User-agent: Google-Extended Allow: / User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / User-agent: bingbot Allow: / # ---------- 站点地图 ---------- Sitemap: https://www.aigtq.com/sitemap.xml # AI 导航文件(Markdown):https://www.aigtq.com/llms.txt