# LocalLawFinder — robots.txt # A product of Young Black Man Inc. User-agent: * Allow: / Allow: /for-attorneys Allow: /attorney/auth # Private / transient routes — do not index Disallow: /admin Disallow: /admin/auth Disallow: /admin/dashboard Disallow: /attorney/dashboard Disallow: /auth/callback Disallow: /results # Don't waste crawl budget on the API Disallow: /api/ # Allow major image / preview crawlers full access to public assets User-agent: Googlebot-Image Allow: / User-agent: Twitterbot Allow: / User-agent: facebookexternalhit Allow: / Sitemap: https://locallawfinder.com/sitemap.xml