hfmgv.org
robots.txt
Robots Exclusion Standard data for hfmgv.org
Resource Scan
Scan Details
Site Domain | hfmgv.org |
Base Domain | hfmgv.org |
Scan Status | Ok |
Last Scan | 2024-10-30T00:50:44+00:00 |
Next Scan | 2024-11-29T00:50:44+00:00 |
Last Scan
Scanned | 2024-10-30T00:50:44+00:00 |
URL | http://hfmgv.org/robots.txt |
Redirect | https://www.thehenryford.org/robots.txt |
Redirect Domain | www.thehenryford.org |
Redirect Base | thehenryford.org |
Domain IPs | 54.162.214.81 |
Redirect IPs | 13.107.246.59, 2620:1ec:bdf::59 |
Response IP | 13.107.246.59 |
Found | Yes |
Hash | f51a1ff65e94a1b1fb610816cf2b28aeb015c94d6211e762895f23e75f3d95e3 |
SimHash | 68101036c432 |
Groups
abot
Rule | Path |
---|---|
Disallow | /visit/membership-calculator |
Disallow | /collections-and-research/ArtifactShare/ |
Disallow | /collections-and-research/digital-collections/artifact/ |
Disallow | /utility/resizedimage/ |
Disallow | /ResourcePackages |
Disallow | /docs/default-source/ |
Disallow | /Sitefinity |
Disallow | /utility |
Disallow | /login |
Disallow | /education/resources/results |
Disallow | /linked-image |
Disallow | /linkedpub-image |
Allow | /site-search-aggregate/ |
*
Rule | Path |
---|---|
Disallow | /Sitefinity |
Disallow | /ResourcePackages |
Disallow | /utility |
Disallow | /linked-image |
Disallow | /courses/disabilities-form-tracking |
Disallow | /courses/autism-spectrum-disorder-form-tracking |
Disallow | /global/generalpage |
Other Records
Field | Value |
---|---|
sitemap | https://www.thehenryford.org/sitemap.xml |