datastoreworks.com
robots.txt

Robots Exclusion Standard data for datastoreworks.com

Resource Scan

Scan Details

Site Domain datastoreworks.com
Base Domain datastoreworks.com
Scan Status Ok
Last Scan2025-11-22T09:18:48+00:00
Next Scan 2025-12-22T09:18:48+00:00

Last Scan

Scanned2025-11-22T09:18:48+00:00
URL https://datastoreworks.com/robots.txt
Domain IPs 104.18.24.183, 104.18.25.183, 2606:4700::6812:18b7, 2606:4700::6812:19b7
Response IP 104.18.24.183
Found Yes
Hash 2f1c1fc3e79f640ebe4e3e4f4b76f5b473dd9a7eb90b8eb955d4f40f1aca75a5
SimHash 2d143345e935

Groups

*

Rule Path
Disallow /aspnet_client/
Disallow /viewcart.asp
Disallow /checkout.asp
Disallow /placeorder.asp
Disallow /thankyou.asp
Disallow /generator/
Disallow /downloads/
Disallow /old/

Other Records

Field Value
sitemap http://www.datastoreworks.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.
  • Sitemap files