wenku.so.com
robots.txt

Robots Exclusion Standard data for wenku.so.com

Resource Scan

Scan Details

Site Domain wenku.so.com
Base Domain so.com
Scan Status Ok
Last Scan2024-09-21T22:59:01+00:00
Next Scan 2024-10-21T22:59:01+00:00

Last Scan

Scanned2024-09-21T22:59:01+00:00
URL https://wenku.so.com/robots.txt
Domain IPs 171.8.167.62, 180.163.251.253
Response IP 171.8.167.62
Found Yes
Hash 8110b7c4ac58ade2d4833fccc5cad9311a0dbc1839f301e0e6a53300e0b1c5f7
SimHash a155511465c7

Groups

baiduspider

Rule Path
Disallow /s?
Disallow /c?
Disallow /pay/
Disallow /order/
Disallow /link

sogou web spider

Rule Path
Disallow /s?
Disallow /c?
Disallow /pay/
Disallow /order/
Disallow /link

googlebot

Rule Path
Disallow /s?
Disallow /c?
Disallow /pay/
Disallow /order/
Disallow /link

bingbot

Rule Path
Disallow /s?
Disallow /c?
Disallow /pay/
Disallow /order/
Disallow /link

toutiaospider

Rule Path
Disallow /

Warnings

  • 6 invalid lines.