historyextra.com
robots.txt
Robots Exclusion Standard data for historyextra.com
Resource Scan
Scan Details
| Site Domain | historyextra.com |
| Base Domain | historyextra.com |
| Scan Status | Ok |
| Last Scan | 2024-06-08T23:23:33+00:00 |
| Next Scan | 2024-06-15T23:23:33+00:00 |
Last Scan
| Scanned | 2024-06-08T23:23:33+00:00 |
| URL | https://historyextra.com/robots.txt |
| Redirect | https://www.historyextra.com/robots.txt |
| Redirect Domain | www.historyextra.com |
| Redirect Base | historyextra.com |
| Domain IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Redirect IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91 |
| Response IP | 199.232.45.91 |
| Found | Yes |
| Hash | c7d5dc9fe361243c985da148891b28af6cd178b61c0b720894df0ebe8d491579 |
| SimHash | 5136098895a3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /wp-admin/ |
| Allow | /wp-admin/admin-ajax.php |
| Disallow | /4817/ |
| Disallow | /176986657/ |
| Disallow | /styleguide/ |
| Disallow | /author/mrben/ |
| Disallow | /register/ |
| Disallow | /signin/ |
| Disallow | /account/ |
| Disallow | /people/ |
| Disallow | /magazine-issue/ |
| Disallow | /v1/ |
| Disallow | /api/ |
| Disallow | /topic/russia-ukraine/ |
| Disallow | /tag/recipes/ |
| Disallow | /wp-sitemap-posts- |
| Disallow | /user/ |
| Disallow | /user/*/collection/ |
| Disallow | /search/ |
| Disallow | /registration |
| Disallow | /registration/ |
| Disallow | /forgotten-password |
| Disallow | /forgotten-password/ |
| Disallow | /change-password/ |
| Disallow | /reset-password |
| Disallow | /reset-password/ |
| Disallow | /membership/ |
| Allow | */page/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.historyextra.com/wp-sitemap.xml |
| sitemap | https://www.historyextra.com/google-news.xml/ |
| sitemap | https://www.historyextra.com/sitemap.xml/ |
| sitemap | https://www.historyextra.com/sitemap.xml |
Comments