disk-partition.com
robots.txt

Robots Exclusion Standard data for disk-partition.com

Resource Scan

Scan Details

Site Domain disk-partition.com
Base Domain disk-partition.com
Scan Status Ok
Last Scan2025-09-14T11:04:05+00:00
Next Scan 2025-09-21T11:04:05+00:00

Last Scan

Scanned2025-09-14T11:04:05+00:00
URL https://disk-partition.com/robots.txt
Redirect https://www.diskpart.com/robots.txt
Redirect Domain www.diskpart.com
Redirect Base diskpart.com
Domain IPs 104.21.79.175, 172.67.146.212, 2606:4700:3034::6815:4faf, 2606:4700:3034::ac43:92d4
Redirect IPs 104.26.2.23, 104.26.3.23, 172.67.72.207, 2606:4700:20::681a:217, 2606:4700:20::681a:317, 2606:4700:20::ac43:48cf
Response IP 104.26.2.23
Found Yes
Hash b89c10aa5e983c4da4e6ee55b6b6f31149acae35b84e34d3f872d4f912a8fa7e
SimHash abbddd000b99

Groups

*

Rule Path
Disallow /newsletter/
Disallow /landing/
Disallow /forum/
Disallow *--tmp.html
Disallow /ss/
Disallow /checkout.php

Other Records

Field Value
sitemap https://www.diskpart.com/sitemap.xml

Comments

  • Robots.txt file from https://www.diskpart.com
  • All robots will spider the domain