Log In Sign Up

muselink.cc
robots.txt

Robots Exclusion Standard data for muselink.cc

Resource Scan

Scan Details

Site Domain muselink.cc
Base Domain muselink.cc
Scan Status Ok
Last Scan2024-10-01T05:14:24+00:00
Next Scan 2024-10-31T05:14:24+00:00

Last Scan

Scanned2024-10-01T05:14:24+00:00
URL https://muselink.cc/robots.txt
Domain IPs 39.96.175.85
Response IP 39.96.175.85
Found Yes
Hash 4a72c45343dd60bda2ec463f636f98c3b8a1ecf6175582b2193d5faccb402ab2
SimHash dc54d5566276

Groups

googlebot

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

googlebot-image

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

baiduspider-news

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

baiduspider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

baiduspider-render

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

baiduspider-image

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

sosospider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

bingbot

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

haosouspider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

yisouspider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

youdaobot

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

sogou orion spider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

sogou news spider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

sogou blog

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

sogou spider2

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

sogou inst spider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

sogou web spider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

easouspider

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

Other Records

Field Value
crawl-delay 10

msnbot

Rule Path
Disallow /s/login
Disallow /s/protocol
Disallow /s/privacy

Other Records

Field Value
crawl-delay 10

bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /
Back to top

Warnings

  • 4 invalid lines.
  • `request-rate` is not a known field.
Back to top