novel.sogou.com
robots.txt

Robots Exclusion Standard data for novel.sogou.com

Resource Scan

Scan Details

Site Domain novel.sogou.com
Base Domain sogou.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-08-11T03:48:19+00:00
Next Scan 2024-11-09T03:48:19+00:00

Last Successful Scan

Scanned2023-03-22T23:02:19+00:00
URL https://novel.sogou.com/robots.txt
Domain IPs 119.28.109.132
Response IP 119.28.109.132
Found Yes
Hash 327a9d9f39750d74e58f1580a9be551007d4aa4159342d534227d772bc8c3907
SimHash 4444d132c973

Groups

baiduspider

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow

sogou inst spider

Rule Path
Disallow

*

Rule Path
Allow /ads.txt
Disallow /