createdbymathias.com
robots.txt

Robots Exclusion Standard data for createdbymathias.com

Resource Scan

Scan Details

Site Domain createdbymathias.com
Base Domain createdbymathias.com
Scan Status Ok
Last Scan2025-11-28T01:08:23+00:00
Next Scan 2025-12-28T01:08:23+00:00

Last Scan

Scanned2025-11-28T01:08:23+00:00
URL https://createdbymathias.com/robots.txt
Domain IPs 104.21.34.222, 172.67.165.235, 2606:4700:3031::6815:22de, 2606:4700:3033::ac43:a5eb
Response IP 104.21.34.222
Found Yes
Hash 12dcc7229652a1b6ca127f595c6e4a41c68c504a2edba24671e42759c45882fb
SimHash e14bd2028fd3

Groups

*

Rule Path
Disallow /
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://createdbymathias.com/sitemap.xml

Warnings

  • 1 invalid line.