pankj.com
robots.txt

Robots Exclusion Standard data for pankj.com

Resource Scan

Scan Details

Site Domain pankj.com
Base Domain pankj.com
Scan Status Ok
Last Scan2024-06-15T18:05:34+00:00
Next Scan 2024-06-22T18:05:34+00:00

Last Scan

Scanned2024-06-15T18:05:34+00:00
URL https://pankj.com/robots.txt
Redirect https://www.pankj.com/robots.txt
Redirect Domain www.pankj.com
Redirect Base pankj.com
Domain IPs 104.21.57.110, 172.67.145.168, 2606:4700:3032::ac43:91a8, 2606:4700:3036::6815:396e
Redirect IPs 104.21.57.110, 172.67.145.168, 2606:4700:3032::ac43:91a8, 2606:4700:3036::6815:396e
Response IP 104.21.57.110
Found Yes
Hash 24dc33bd089a9c461bae362b9284267642cf80cc21161057d82b5765fab22ca5
SimHash 35d59fe1cd76

Groups

*
google
googlebot
slurp
teoma
askjeeves
msnbot
grub
atn
digger
informant
infoseek
lycos
marvin
robozilla
scooter
smartspider
spider_monkey

Product Comment
google Google
googlebot Google
slurp Yahoo
teoma Ask
askjeeves Ask
msnbot MSN
grub Wiki
atn All That Net
digger Diggit !
informant Search the web
infoseek Infoseek
lycos Lycos
marvin Infoseek
robozilla Mozilla
scooter AltaVista
smartspider Travel-Finder
spider_monkey MPRM Group

No rules defined. All paths allowed.

Comments

  • robots.txt for https://www.pankj.com/