123-reg.co.uk
robots.txt
Robots Exclusion Standard data for 123-reg.co.uk
Resource Scan
Scan Details
| Site Domain | 123-reg.co.uk |
| Base Domain | 123-reg.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-04-25T18:58:45+00:00 |
| Next Scan | 2024-05-25T18:58:45+00:00 |
Last Scan
| Scanned | 2024-04-25T18:58:45+00:00 |
| URL | https://123-reg.co.uk/robots.txt |
| Redirect | https://www.123-reg.co.uk/robots.txt |
| Redirect Domain | www.123-reg.co.uk |
| Redirect Base | 123-reg.co.uk |
| Domain IPs | 23.215.7.12, 23.215.7.24, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:718 |
| Redirect IPs | 23.52.171.202, 23.52.171.218, 2600:1413:b000:1b::17d7:70c, 2600:1413:b000:1b::17d7:718 |
| Response IP | 23.52.171.218 |
| Found | Yes |
| Hash | e861a9bc5af18716fba9b765c03a1ce791f39caeab66eb8a2643190ab2ee087c |
| SimHash | e1012130a0c7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /secure |
| Disallow | /banners/ |
| Disallow | */admin/ |
| Disallow | /order/ |
| Disallow | /products/ |
| Disallow | /full_whois.cgi |
| Disallow | /blog/wp-admin |
| Disallow | /blog/search/ |
| Disallow | /blog/archives/darwin-awards-pet-porn-and-hand-grenades |
| Disallow | /blog/interviews/darwin-awards-pet-porn-and-hand-grenades |
| Disallow | */DisplayFile.aspx |
| Disallow | */displayfile.aspx |
| Disallow | /support/*SendMail.aspx* |
| Disallow | /support/*sendmail.aspx* |
| Disallow | /affiliate.cgi |
| Disallow | /affiliate2.cgi |
| Disallow | /*medium%3DAffiliate* |
| Disallow | /*medium%3Daffiliate* |
| Disallow | /support/search.aspx* |
| Disallow | */cj_redirect_in.cgi |
| Disallow | /tel-domain-registration/ |
| Disallow | /123com.shtml |
| Disallow | /extras/ |
| Disallow | /empty-basket/ |
| Disallow | /support/StartChat.aspx |
| Disallow | /*?domain=* |
| Disallow | /staff/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.123-reg.co.uk/sitemap.xml |
| sitemap | https://www.123-reg.co.uk/support/sitemap_index.xml |
| sitemap | https://www.123-reg.co.uk/blog/sitemap_index.xml |
Comments