42flows launch posture
Allow public marketing/docs pages, block dashboard and API routes, and expose the sitemap.
QuestionP1
What is robots.txt?
robots.txt tells crawlers which paths they should avoid and where to find the sitemap.
Direct answer
robots.txt is a public crawler instruction file. It should allow useful public pages and block private app routes.