thegenealogist.co.uk
robots.txt
Robots Exclusion Standard data for thegenealogist.co.uk
Resource Scan
Scan Details
| Site Domain | thegenealogist.co.uk |
| Base Domain | thegenealogist.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-21T13:59:17+00:00 |
| Next Scan | 2024-10-05T13:59:17+00:00 |
Last Scan
| Scanned | 2024-09-21T13:59:17+00:00 |
| URL | https://thegenealogist.co.uk/robots.txt |
| Redirect | https://www.thegenealogist.co.uk/robots.txt |
| Redirect Domain | www.thegenealogist.co.uk |
| Redirect Base | thegenealogist.co.uk |
| Domain IPs | 104.26.2.174, 104.26.3.174, 172.67.68.197, 2606:4700:20::681a:2ae, 2606:4700:20::681a:3ae, 2606:4700:20::ac43:44c5 |
| Redirect IPs | 104.26.2.174, 104.26.3.174, 172.67.68.197, 2606:4700:20::681a:2ae, 2606:4700:20::681a:3ae, 2606:4700:20::ac43:44c5 |
| Response IP | 104.26.2.174 |
| Found | Yes |
| Hash | 6f55c40b859f0358bee19ff837a14e8fb8fa62ff3af2b9fcc0739453f227eb2d |
| SimHash | 79d4db60e5d6 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /mts/ |
| Disallow | /mi/ |
| Disallow | /content/search_result.php |
| Disallow | /search/master/ |
| Disallow | /image_viewer/ |
| Disallow | /featuredarticles/discover-your-ancestors/print/ |
| Disallow | /account/signup/ |