aeclectic.net
robots.txt

Robots Exclusion Standard data for aeclectic.net

Resource Scan

Scan Details

Site Domain aeclectic.net
Base Domain aeclectic.net
Scan Status Ok
Last Scan2024-11-02T18:46:32+00:00
Next Scan 2024-11-09T18:46:32+00:00

Last Scan

Scanned2024-11-02T18:46:32+00:00
URL https://aeclectic.net/robots.txt
Redirect https://www.aeclectic.net/robots.txt
Redirect Domain www.aeclectic.net
Redirect Base aeclectic.net
Domain IPs 66.39.20.133
Redirect IPs 66.39.20.133
Response IP 66.39.20.133
Found Yes
Hash dcfa75fd4d28e734526737f313eb9c18b6742803c983dbb46c94a26a059c164d
SimHash 3053c940e397

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /cgi-sys/
Disallow /cgi/
Disallow /admin/
Disallow /cgi/
Disallow /tarot/cards/decksort.shtml

npbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /