yp.zhupiter.com
robots.txt

Robots Exclusion Standard data for yp.zhupiter.com

Resource Scan

Scan Details

Site Domain yp.zhupiter.com
Base Domain zhupiter.com
Scan Status Ok
Last Scan2024-09-29T16:21:14+00:00
Next Scan 2024-10-06T16:21:14+00:00

Last Scan

Scanned2024-09-29T16:21:14+00:00
URL https://yp.zhupiter.com/robots.txt
Domain IPs 35.236.168.25
Response IP 35.236.168.25
Found Yes
Hash ab47f613b62cc1a1cc15b8d1d72544c7e0c63f30222941742bdcc6b15faf91b1
SimHash 411c9c41c252

Groups

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

imagesiftbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://yp.zhupiter.com/sitemap/sitemap-index.xml