Log In Sign Up

data.zhupiter.com
robots.txt

Robots Exclusion Standard data for data.zhupiter.com

Resource Scan

Scan Details

Site Domain data.zhupiter.com
Base Domain zhupiter.com
Scan Status Ok
Last Scan2024-11-15T03:49:54+00:00
Next Scan 2024-11-22T03:49:54+00:00

Last Scan

Scanned2024-11-15T03:49:54+00:00
URL https://data.zhupiter.com/robots.txt
Domain IPs 35.236.168.25
Response IP 35.236.168.25
Found Yes
Hash 29df5a842922caa5abdda0ffc9a13819ee961b2ebb7bf9803f2f4764da211bc3
SimHash 511cc840d632

Groups

bytespider

Rule Path
Disallow /

bytedance

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

adsbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrush

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

facebookbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://data.zhupiter.com/sitemap/sitemap-index.xml
Back to top

Comments

  • User-agent: proximic
  • Disallow:/
Back to top