mindtools.com
robots.txt

Robots Exclusion Standard data for mindtools.com

Resource Scan

Scan Details

Site Domain mindtools.com
Base Domain mindtools.com
Scan Status Ok
Last Scan2024-05-28T17:19:53+00:00
Next Scan 2024-06-04T17:19:53+00:00

Last Scan

Scanned2024-05-28T17:19:53+00:00
URL https://mindtools.com/robots.txt
Redirect https://www.mindtools.com/robots.txt
Redirect Domain www.mindtools.com
Redirect Base mindtools.com
Domain IPs 13.224.163.105, 13.224.163.120, 13.224.163.34, 13.224.163.80, 2600:9000:20c7:200:1a:51d4:a880:93a1, 2600:9000:20c7:4200:1a:51d4:a880:93a1, 2600:9000:20c7:5200:1a:51d4:a880:93a1, 2600:9000:20c7:6800:1a:51d4:a880:93a1, 2600:9000:20c7:ba00:1a:51d4:a880:93a1, 2600:9000:20c7:c00:1a:51d4:a880:93a1, 2600:9000:20c7:de00:1a:51d4:a880:93a1, 2600:9000:20c7:f800:1a:51d4:a880:93a1
Redirect IPs 13.35.18.113, 13.35.18.18, 13.35.18.25, 13.35.18.27, 2600:9000:20c7:2e00:1a:51d4:a880:93a1, 2600:9000:20c7:3600:1a:51d4:a880:93a1, 2600:9000:20c7:6000:1a:51d4:a880:93a1, 2600:9000:20c7:6a00:1a:51d4:a880:93a1, 2600:9000:20c7:ba00:1a:51d4:a880:93a1, 2600:9000:20c7:c800:1a:51d4:a880:93a1, 2600:9000:20c7:e400:1a:51d4:a880:93a1, 2600:9000:20c7:f400:1a:51d4:a880:93a1
Response IP 13.35.18.27
Found Yes
Hash aa0b05a5f4eacb7cf5c595c13ddbacd676b9a4621626f7a0bef2c845b68eea32
SimHash e1444c51ef93

Groups

*

Rule Path
Disallow /__system/*
Disallow /a72g4xbonus/*
Disallow /media/Resized-Images/*

Other Records

Field Value
sitemap https://www.mindtools.com/sitemap.xml

Comments

  • https://www.robotstxt.org/robotstxt.html