ianatkinson.net
robots.txt

Robots Exclusion Standard data for ianatkinson.net

Resource Scan

Scan Details

Site Domain ianatkinson.net
Base Domain ianatkinson.net
Scan Status Ok
Last Scan2025-05-14T18:01:35+00:00
Next Scan 2025-05-21T18:01:35+00:00

Last Scan

Scanned2025-05-14T18:01:35+00:00
URL https://ianatkinson.net/robots.txt
Domain IPs 185.114.98.6, 2a00:1ee0:2:207::b972:6206
Response IP 185.114.98.6
Found Yes
Hash d7d978b5cbf496a9538c28c85e19e2a55a03239b1625b04fcd6a1d0d3c049a8c
SimHash f534d482f378

Groups

*

Rule Path
Disallow /files
Disallow /test.htm
Disallow /404.htm
Disallow *.css$

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

aspiegelbot

Rule Path
Disallow /

aspiegel

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

pinterest

Rule Path
Disallow /