tuffclassified.com
robots.txt

Robots Exclusion Standard data for tuffclassified.com

Resource Scan

Scan Details

Site Domain tuffclassified.com
Base Domain tuffclassified.com
Scan Status Ok
Last Scan2026-01-17T04:38:54+00:00
Next Scan 2026-01-24T04:38:54+00:00

Last Scan

Scanned2026-01-17T04:38:54+00:00
URL https://tuffclassified.com/robots.txt
Domain IPs 2400:d321:2239:6329::1, 82.180.147.83
Response IP 82.180.147.83
Found Yes
Hash ab5da48f18f0df2add5eda8c5b19b7827e6afc67b25ed7681ca60815ed8a85fb
SimHash 4d4a1e01e0e1

Groups

*

Rule Path
Disallow /item/
Allow /item/new
Disallow /oc-admin/
Allow /

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://tuffclassified.com/sitemapindex.xml

Comments

  • robots.txt for tuffclassified.com
  • Block all URLs under /item/ except /item/new
  • Block other sensitive paths
  • Disallow: /search/page
  • Allow all other content to be indexed
  • Reduce server load by limiting crawl rate
  • Sitemap location