# Robots.txt for justhappened.wtf User-agent: * # Allow all public content Allow: / Allow: /a/ Allow: /analysis/ Allow: /stocks/ # Disallow admin and private routes Disallow: /api/admin/ Disallow: /api/user/ Disallow: /api/auth/ Disallow: /api/refresh Disallow: /api/portfolio Disallow: /api/watchlist Disallow: /stocks/internal/ Disallow: /mcp # Sitemap locations (nginx proxies to API for dynamic generation) Sitemap: https://justhappened.wtf/sitemap.xml Sitemap: https://justhappened.wtf/sitemap-news.xml Sitemap: https://justhappened.wtf/sitemap-stocks.xml