hydrogenfuelnews.com
robots.txt

Robots Exclusion Standard data for hydrogenfuelnews.com

Resource Scan

Scan Details

Site Domain hydrogenfuelnews.com
Base Domain hydrogenfuelnews.com
Scan Status Ok
Last Scan2024-11-16T21:20:46+00:00
Next Scan 2024-11-23T21:20:46+00:00

Last Scan

Scanned2024-11-16T21:20:46+00:00
URL https://hydrogenfuelnews.com/robots.txt
Domain IPs 172.66.40.141, 172.66.43.115, 2606:4700:3108::ac42:288d, 2606:4700:3108::ac42:2b73
Response IP 172.66.43.115
Found Yes
Hash bb47051f3925831d655a4b1200ea1bfae361d503fe0330fc7bd0467a038e0d10
SimHash e512d222c3f7

Groups

bingbot

Rule Path
Allow /

x-middleton/1

Rule Path
Disallow /

Comments

  • Allow bing
  • User-agent: *
  • Crawl-delay: 15