freereg.org.uk
robots.txt
Robots Exclusion Standard data for freereg.org.uk
Resource Scan
Scan Details
| Site Domain | freereg.org.uk |
| Base Domain | freereg.org.uk |
| Scan Status | Ok |
| Last Scan | 2024-06-02T15:37:08+00:00 |
| Next Scan | 2024-06-09T15:37:08+00:00 |
Last Scan
| Scanned | 2024-06-02T15:37:08+00:00 |
| URL | https://freereg.org.uk/robots.txt |
| Redirect | https://www.freereg.org.uk/robots.txt |
| Redirect Domain | www.freereg.org.uk |
| Redirect Base | freereg.org.uk |
| Domain IPs | 5.9.125.163 |
| Redirect IPs | 5.9.125.163 |
| Response IP | 5.9.125.163 |
| Found | Yes |
| Hash | de018480c002e00c305639ff1ef0b5e1d3ce432c6f566e5f5eb22481fe5f6a2d |
| SimHash | 4054ab40d4b1 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | /cms/about |
| Allow | /cms/donate |
| Allow | /cms/help |
| Allow | /cms/refinery/login |
| Allow | /cms/information-for-transcribers |
| Allow | /cms/information-for-coordinators |
| Allow | /cms/opportunities-to-volunteer-with-freereg |
| Allow | /search_queries/new |
| Allow | /contacts/new |
| Allow | /search_statistics |
| Allow | /freereg_contents |
| Allow | /sitemap_location.txt |
| Disallow | /userid_details |
| Disallow | /search_queries |
| Disallow | /search_records |
| Disallow | /contacts |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.freereg.org.uk/sitemap_location.txt |
Comments