# robots.txt for dp3tech.com User-agent: * Allow: / # Sitemap Sitemap: https://www.dp3tech.com/sitemap.xml # LLM context files: # https://www.dp3tech.com/llms.txt (index) # https://www.dp3tech.com/llms-full.txt (full text, key pages) # AI / answer-engine crawlers. # The wildcard rule above already permits all of these; naming them is an # explicit statement of intent, so a future edit that narrows access has to # be deliberate rather than accidental. # OpenAI — https://platform.openai.com/docs/bots User-agent: GPTBot Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ChatGPT-User Allow: / # Anthropic — https://support.claude.com/en/articles/8896518 User-agent: ClaudeBot Allow: / User-agent: Claude-User Allow: / User-agent: Claude-SearchBot Allow: / # Perplexity — https://docs.perplexity.ai/guides/bots User-agent: PerplexityBot Allow: / User-agent: Perplexity-User Allow: / # Google AI training / Gemini grounding (separate from Googlebot) User-agent: Google-Extended Allow: / # Apple User-agent: Applebot Allow: / User-agent: Applebot-Extended Allow: / # Meta User-agent: meta-externalagent Allow: / # Amazon User-agent: Amazonbot Allow: / # Common Crawl — a corpus many models train from User-agent: CCBot Allow: /