# Youmeverse — robots.txt # The app itself is a client-rendered SPA behind auth for most routes; the # public surface is just the marketing/install shell at "/". Nothing here is # sensitive, so we default to allowing all crawlers. User-agent: * Allow: / # --- AI / LLM crawlers — explicitly welcomed ------------------------------- # Named out for clarity even though "User-agent: *" already covers them. User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: OAI-SearchBot Allow: / User-agent: ClaudeBot Allow: / User-agent: anthropic-ai Allow: / User-agent: Claude-Web Allow: / User-agent: PerplexityBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://youmeverse.web.app/sitemap.xml