Log In Sign Up

procore-gateway-production-us00-1976868624.us-east-1.elb.amazonaws.com
robots.txt

Robots Exclusion Standard data for procore-gateway-production-us00-1976868624.us-east-1.elb.amazonaws.com

Resource Scan

Scan Details

Site Domain procore-gateway-production-us00-1976868624.us-east-1.elb.amazonaws.com
Base Domain procore-gateway-production-us00-1976868624.us-east-1.elb.amazonaws.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-06T02:28:09+00:00
Next Scan 2025-09-04T02:28:09+00:00

Last Successful Scan

Scanned2023-11-07T15:09:39+00:00
URL http://procore-gateway-production-us00-1976868624.us-east-1.elb.amazonaws.com/robots.txt
Domain IPs 23.23.39.159, 2600:1f18:745:8101:4620:18b5:1650:20f7, 2600:1f18:745:8102:c3a1:a3e2:38a8:c360, 2600:1f18:745:8103:3a1a:66f0:476f:3dd4, 3.82.74.201, 34.206.30.92
Response IP 23.23.39.159
Found Yes
Hash 868b61ef77ab48df1283461a3e84c0fac6fa187dac55a88071be257dc363a81d
SimHash 040099408ffb

Groups

*

Rule Path
Allow /login
Allow /.well-known/*
Allow /fas/*
Disallow /
Back to top

Comments

  • Allowing everything for FAS so crawlers can see and respect x-robots-tag header. More details here: https://github.com/procore/system-design-records/pull/468
Back to top