mindpicnic.com
robots.txt

Robots Exclusion Standard data for mindpicnic.com

Resource Scan

Scan Details

Site Domain mindpicnic.com
Base Domain mindpicnic.com
Scan Status Ok
Last Scan2024-05-01T13:24:46+00:00
Next Scan 2024-05-31T13:24:46+00:00

Last Scan

Scanned2024-05-01T13:24:46+00:00
URL https://mindpicnic.com/robots.txt
Redirect https://www.mindpicnic.com/robots.txt
Redirect Domain www.mindpicnic.com
Redirect Base mindpicnic.com
Domain IPs 104.26.6.22, 104.26.7.22, 172.67.68.100, 2606:4700:20::681a:616, 2606:4700:20::681a:716, 2606:4700:20::ac43:4464
Redirect IPs 104.26.6.22, 104.26.7.22, 172.67.68.100, 2606:4700:20::681a:616, 2606:4700:20::681a:716, 2606:4700:20::ac43:4464
Response IP 104.26.7.22
Found Yes
Hash f491e106966f7038ec0ecadba158b735756235e00b14b63f6e12b79cd5ae6c96
SimHash 0024deeac513

Groups

*

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

linkwalker

Rule Path
Disallow /

teoma

Rule Path
Disallow /

scrubby

Rule Path
Disallow /

nutch

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

gaisbot

Rule Path
Disallow /