richmondfed.org
robots.txt
Robots Exclusion Standard data for richmondfed.org
Resource Scan
Scan Details
Site Domain | richmondfed.org |
Base Domain | richmondfed.org |
Scan Status | Ok |
Last Scan | 2024-05-22T18:03:59+00:00 |
Next Scan | 2024-06-21T18:03:59+00:00 |
Last Scan
Scanned | 2024-05-22T18:03:59+00:00 |
URL | https://www.richmondfed.org/robots.txt |
Domain IPs | 23.44.4.147, 23.44.4.187, 2600:1413:5000:12::1737:27f5, 2600:1413:5000:12::1737:27fb |
Response IP | 23.44.4.187 |
Found | Yes |
Hash | 816035c8d912ee5d26ad9584c26fd5d5e570f63bcb6e640ed9d91f128779240e |
SimHash | 893d555007bb |
Groups
*
Rule | Path |
---|---|
Disallow | /*? |
Disallow | /404 |
Disallow | /500 |
Disallow | /503 |
Disallow | *.js* |
Disallow | /vrs/ |
Disallow | *.css* |
Disallow | *.cgi* |
Disallow | *.jpg* |
Disallow | *.gif* |
Disallow | *.png* |
Disallow | *.tif* |
Disallow | *.svg* |
Disallow | /HTML/ |
Disallow | /search/ |
Disallow | /surveys/ |
Disallow | *print%3D1* |
Disallow | /sitelib/ |
Disallow | /500.html |
Disallow | /503.html |
Disallow | /offsite/ |
Disallow | /feedback/ |
Disallow | /resources/ |
Disallow | /blank.html |
Disallow | /contact_us/ |
Disallow | /ErrorPages/ |
Disallow | /test_content_final |
Disallow | /newemployeeconnections/ |
Disallow | /publications/print_subscription |
Disallow | /publications/single_issue_pub_request |
Disallow | /publications/education/education_pub_request |
Disallow | /banking/education_for_bankers/speakers_bureau |
Disallow | /-/media/RichmondFedOrg/publications/research/working_papers/2019/wp19-08_data_educational_attainment.xlsx |