materialtools.com
robots.txt

Robots Exclusion Standard data for materialtools.com

Resource Scan

Scan Details

Site Domain materialtools.com
Base Domain materialtools.com
Scan Status Ok
Last Scan2025-11-30T08:25:51+00:00
Next Scan 2025-12-07T08:25:51+00:00

Last Scan

Scanned2025-11-30T08:25:51+00:00
URL https://materialtools.com/robots.txt
Redirect https://www.storytrain.info/robots.txt
Redirect Domain www.storytrain.info
Redirect Base storytrain.info
Domain IPs 104.21.20.71, 172.67.191.222, 2606:4700:3030::6815:1447, 2606:4700:3036::ac43:bfde
Redirect IPs 38.47.108.106, 47.240.73.6
Response IP 47.240.73.6
Found Yes
Hash 8c63772755bd9fa41cb2d4b3295574e7bdf5e334b7de7ffa7a851fc78ec7a500
SimHash 485c9822fb10

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

*

Rule Path
Disallow /document/storage/
Allow /