# Allow all well-behaved crawlers full access. The marketing site is # entirely public — anything behind /dashboard, /sessions, /billing, etc. # is gated server-side by JWT auth so listing them here would be redundant. User-agent: * Allow: / # Authenticated pages — explicit disallow so crawlers don't waste budget # on URLs that return a JWT-gated login redirect. Disallow: /dashboard Disallow: /sessions Disallow: /credits Disallow: /billing Disallow: /settings Disallow: /admin Disallow: /device-verify Disallow: /reset-password Disallow: /forgot-password Disallow: /login Disallow: /signup Disallow: /auth/ Sitemap: https://www.nostrobeai.com/sitemap-index.xml