First checks
Look for private-route blocks, sitemap reference, accidental Disallow: /, and whether public pages are crawlable.
A single robots.txt mistake can block the pages a business most wants crawled.
Look for private-route blocks, sitemap reference, accidental Disallow: /, and whether public pages are crawlable.