lianjia.com
robots.txt

Robots Exclusion Standard data for lianjia.com

Resource Scan

Scan Details

Site Domain lianjia.com
Base Domain lianjia.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-03T22:21:57+00:00
Next Scan 2024-07-10T22:21:57+00:00

Last Successful Scan

Scanned2024-06-02T22:21:11+00:00
URL https://lianjia.com/robots.txt
Domain IPs 152.136.248.2, 2403:a200:a200:13f1:183:84:18:11
Response IP 152.136.248.2
Found Yes
Hash 55b781086e67b70368a044b3f49d87a4556198686ab42052c6f1f28ef9ac1bff
SimHash 4821317243f0

Groups

baiduspider

Rule Path
Allow /

googlebot

Rule Path
Allow /

haosouspider

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

sosospider

Rule Path
Allow /

sogou news spider

Rule Path
Allow /

yahoo! slurp china

Rule Path
Allow /

yahoo!

Rule Path
Allow /

youdaobot

Rule Path
Allow /

yodaobot

Rule Path
Allow /

sogou news spider

Rule Path
Allow /

bingbot

Rule Path
Allow /

yisouspider

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

easouspider

Rule Path
Allow /

jikespider

Rule Path
Allow /

etaospider

Rule Path
Allow /

*

Rule Path
Disallow /

Warnings

  • 2 invalid lines.