centretank.com
robots.txt

Robots Exclusion Standard data for centretank.com

Resource Scan

Scan Details

Site Domain centretank.com
Base Domain centretank.com
Scan Status Ok
Last Scan2026-02-05T18:10:49+00:00
Next Scan 2026-02-19T18:10:49+00:00

Last Scan

Scanned2026-02-05T18:10:49+00:00
URL https://centretank.com/robots.txt
Redirect https://www.centretank.com/robots.txt
Redirect Domain www.centretank.com
Redirect Base centretank.com
Domain IPs 87.239.18.137
Redirect IPs 87.239.18.137
Response IP 87.239.18.137
Found Yes
Hash 585b2b3cdd2914f01ba271bde6de616dac0bf7edcf0fbe3eb3f34f598b4e8363
SimHash e1249902e633

Groups

*

Rule Path
Disallow /cpresources/

Other Records

Field Value
sitemap https://foo.com/sitemap.xml

Comments

  • www.robotstxt.org/
  • Sitemaps
  • Don't allow crawling of cpresources/