britain-magazine.telegraph.co.uk
robots.txt
Robots Exclusion Standard data for britain-magazine.telegraph.co.uk
Resource Scan
Scan Details
Site Domain | britain-magazine.telegraph.co.uk |
Base Domain | telegraph.co.uk |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-02-26T10:52:29+00:00 |
Next Scan | 2025-05-27T10:52:29+00:00 |
Last Successful Scan
Scanned | 2024-01-11T09:14:38+00:00 |
URL | https://britain-magazine.telegraph.co.uk/robots.txt |
Redirect | https://www.britain-magazine.com/robots.txt |
Redirect Domain | www.britain-magazine.com |
Redirect Base | britain-magazine.com |
Domain IPs | 23.211.140.73, 23.211.140.88 |
Redirect IPs | 23.52.171.121, 23.52.171.136 |
Response IP | 42.99.140.161 |
Found | Yes |
Hash | 13cd58234ce542bdb21a9eb8e097f86218d1469aada649cd0d7affeb56781eee |
SimHash | a944da0081d7 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /?s=* |
Disallow | /wp-admin/ |
Disallow | /cmc_login/ |
Disallow | /directory/wp-login* |
Other Records
Field | Value |
---|---|
sitemap | https://www.britain-magazine.com/sitemap_index.xml |