hupu.com
robots.txt

Robots Exclusion Standard data for hupu.com

Resource Scan

Scan Details

Site Domain hupu.com
Base Domain hupu.com
Scan Status Ok
Last Scan2024-11-15T06:30:54+00:00
Next Scan 2024-11-22T06:30:54+00:00

Last Scan

Scanned2024-11-15T06:30:54+00:00
URL https://hupu.com/robots.txt
Redirect https://www.hupu.com/robots.txt
Redirect Domain www.hupu.com
Redirect Base hupu.com
Domain IPs 114.55.187.22
Redirect IPs 101.33.26.139, 101.33.26.185, 101.33.26.246, 240d:c010:125::4, 240d:c010:126:1::97, 240d:c010:15c:1::a1, 240d:c010:15c:1::a2, 240d:c010:5b:4::24d, 240d:c010:81:1::71, 240d:c010:81:1::75, 240d:c010:81:1::76, 240d:c010:81:1::77, 43.132.80.175, 43.132.80.77, 43.159.70.67, 43.159.70.70, 43.174.32.211, 43.174.32.212, 43.174.51.192, 43.175.138.217, 43.175.138.218, 43.175.139.70, 43.175.139.72, 43.175.154.12
Response IP 43.159.70.70
Found Yes
Hash e6f5a4ac4c43aab7207ccff73de6849d36b82b16cd8302eff931063d49df0846
SimHash e144dd72e34b

Groups

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

baiduspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

yisouspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

baiduspider-ads

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sosospider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sogou news spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sogou blog

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sogou spider2

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sogou inst spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sogou web spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sogou wap spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

sogou orion spider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

bytespider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

toutiaospider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

yisouspider

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

*

Rule Path
Disallow /