Log In Sign Up

12andus.com
robots.txt

Robots Exclusion Standard data for 12andus.com

Resource Scan

Scan Details

Site Domain 12andus.com
Base Domain 12andus.com
Scan Status Ok
Last Scan2026-01-11T11:44:17+00:00
Next Scan 2026-01-18T11:44:17+00:00

Last Scan

Scanned2026-01-11T11:44:17+00:00
URL https://12andus.com/robots.txt
Domain IPs 116.202.49.33
Response IP 116.202.49.33
Found Yes
Hash 9135943d32f317dfa8a1a9c6e0053e0727419af3b629b408dea7bb05373ba2e6
SimHash 59004b0187f2

Groups

facebookexternalhit

Rule Path
Allow /

facebot

Rule Path
Allow /

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://12andus.com/sitemap.xml
Back to top

Comments

  • 12andus.com robots.txt
  • OLD RULES (commented out for social sharing - 2025-11-17):
  • Allow only home page and blog - everything else requires login
  • All bots: Block everything except home and blog
  • User-agent: *
  • Disallow: /
  • Allow: /$
  • Allow: /blog/
  • NEW RULES (for social sharing):
  • Explicitly allow Facebook bot (they cache robots.txt for 24h)
  • Allow all other bots
  • Sitemap (if you have one)
Back to top