pujia8.com
robots.txt

Robots Exclusion Standard data for pujia8.com

Resource Scan

Scan Details

Site Domain pujia8.com
Base Domain pujia8.com
Scan Status Ok
Last Scan2024-11-11T03:59:36+00:00
Next Scan 2024-11-18T03:59:36+00:00

Last Scan

Scanned2024-11-11T03:59:36+00:00
URL https://pujia8.com/robots.txt
Domain IPs 219.83.191.12
Response IP 219.83.191.12
Found Yes
Hash db035ce8e18e14d719603a4ddf5f709f5b0db80cba26affe9b1140155d8369ee
SimHash 755145067557

Groups

sosospider<br>disallow: /<br>user-agent: sogou web spider<br>disallow: /<br>user-agent: sogou spider<br>disallow: /<br>user-agent: yodaobot<br>disallow: /<br>user-agent: *<br>disallow:<br>crawl-delay: 60

No rules defined. All paths allowed.