craftbindings.com
robots.txt

Robots Exclusion Standard data for craftbindings.com

Resource Scan

Scan Details

Site Domain craftbindings.com
Base Domain craftbindings.com
Scan Status Ok
Last Scan2024-09-23T09:58:52+00:00
Next Scan 2024-09-30T09:58:52+00:00

Last Scan

Scanned2024-09-23T09:58:52+00:00
URL https://craftbindings.com/robots.txt
Domain IPs 130.211.40.170
Response IP 130.211.40.170
Found Yes
Hash 727929001c0e67fce72523d199130c495ce2168924d5b15f2210d0812c3808d3
SimHash 4d115496cd12

Groups

spinn3r

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /thanks
Disallow */listing/*/similar

Other Records

Field Value
sitemap https://www.craftbindings.com/sitemaps.xml?sitemap=listings&offset=0
sitemap https://www.craftbindings.com/sitemaps.xml?sitemap=blogs&offset=0
sitemap https://www.craftbindings.com/sitemaps.xml?sitemap=pages&offset=0

Comments

  • \
  • -----
  • | . . |
  • -----
  • \--|-|--/
  • | |
  • |-------|