hpcadvisorycouncil.com
robots.txt

Robots Exclusion Standard data for hpcadvisorycouncil.com

Resource Scan

Scan Details

Site Domain hpcadvisorycouncil.com
Base Domain hpcadvisorycouncil.com
Scan Status Ok
Last Scan2024-06-02T11:42:53+00:00
Next Scan 2024-07-02T11:42:53+00:00

Last Scan

Scanned2024-06-02T11:42:53+00:00
URL https://www.hpcadvisorycouncil.com/robots.txt
Domain IPs 2600:9000:23d2:2a00:0:a8a3:d700:93a1, 2600:9000:23d2:6800:0:a8a3:d700:93a1, 2600:9000:23d2:a200:0:a8a3:d700:93a1, 2600:9000:23d2:aa00:0:a8a3:d700:93a1, 2600:9000:23d2:b800:0:a8a3:d700:93a1, 2600:9000:23d2:c00:0:a8a3:d700:93a1, 2600:9000:23d2:c200:0:a8a3:d700:93a1, 2600:9000:23d2:d200:0:a8a3:d700:93a1, 54.192.18.10, 54.192.18.18, 54.192.18.46, 54.192.18.89
Response IP 18.155.68.129
Found Yes
Hash 885ece1835d3d7106496ced8aab5b58cd83465ed3d8b7ee8a5dab687d79622e8
SimHash 8808db22a6a2

Groups

*

Rule Path
Disallow /

ravencrawler
rogerbot
dotbot
semrushbot
semrushbot-sa
powermapper
swiftbot

Rule Path
Allow /

Comments

  • Pantheon's documentation on robots.txt: https://pantheon.io/docs/bots-and-indexing/