# Robots.txt for palm-reading app # We welcome all crawlers, including AI crawlers, to index our content User-agent: * Allow: / Disallow: /*?*q= Disallow: /privacy-policy Disallow: /terms-of-service Disallow: /settings/ Disallow: /activity/ Disallow: /admin/ Disallow: /api/ # Sitemap Sitemap: https://palm-reading.app/sitemap.xml # AI Crawlers - Explicitly Welcome # We welcome AI crawlers to index our content for training and reference purposes User-agent: GPTBot Allow: / Crawl-delay: 1 User-agent: ChatGPT-User Allow: / Crawl-delay: 1 User-agent: CCBot Allow: / Crawl-delay: 1 User-agent: anthropic-ai Allow: / Crawl-delay: 1 User-agent: Claude-Web Allow: / Crawl-delay: 1 User-agent: Google-Extended Allow: / Crawl-delay: 1 User-agent: PerplexityBot Allow: / Crawl-delay: 1 User-agent: Applebot-Extended Allow: / Crawl-delay: 1 User-agent: Bytespider Allow: / Crawl-delay: 1 User-agent: Diffbot Allow: / Crawl-delay: 1 User-agent: FacebookBot Allow: / Crawl-delay: 1 # LLMS.txt - Structured content for AI understanding # See https://palm-reading.app/llms.txt for detailed site information