moy.cat
robots.txt

Robots Exclusion Standard data for moy.cat

Resource Scan

Scan Details

Site Domain moy.cat
Base Domain moy.cat
Scan Status Ok
Last Scan2024-10-21T16:50:33+00:00
Next Scan 2024-11-20T16:50:33+00:00

Last Scan

Scanned2024-10-21T16:50:33+00:00
URL https://moy.cat/robots.txt
Domain IPs 104.21.91.120, 172.67.218.51, 2606:4700:3036::6815:5b78, 2606:4700:3036::ac43:da33
Response IP 172.67.218.51
Found Yes
Hash 3cc72e77925089d7367743a30356d810169ee6ef156cd3a22a1e0de50c8e7263
SimHash 9a64d53e6b3a

Groups

baiduspider

Rule Path
Disallow /

baiduspider-image

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou inst spider

Rule Path
Disallow /

sogou spider2

Rule Path
Disallow /

sogou blog

Rule Path
Disallow /

sogou news spider

Rule Path
Disallow /

sogou orion spider

Rule Path
Disallow /

chinasospider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

yyspider

Rule Path
Disallow /

toutiaospider

Rule Path
Disallow /

haosouspider

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

Warnings

  • 2 invalid lines.