encyclopedia-titanica.org
robots.txt
Robots Exclusion Standard data for encyclopedia-titanica.org
Resource Scan
Scan Details
| Site Domain | encyclopedia-titanica.org |
| Base Domain | encyclopedia-titanica.org |
| Scan Status | Ok |
| Last Scan | 2024-11-15T00:12:50+00:00 |
| Next Scan | 2024-11-22T00:12:50+00:00 |
Last Scan
| Scanned | 2024-11-15T00:12:50+00:00 |
| URL | https://encyclopedia-titanica.org/robots.txt |
| Redirect | https://www.encyclopedia-titanica.org/robots.txt |
| Redirect Domain | www.encyclopedia-titanica.org |
| Redirect Base | encyclopedia-titanica.org |
| Domain IPs | 172.66.40.150, 172.66.43.106, 2606:4700:3108::ac42:2896, 2606:4700:3108::ac42:2b6a |
| Redirect IPs | 172.66.40.150, 172.66.43.106, 2606:4700:3108::ac42:2896, 2606:4700:3108::ac42:2b6a |
| Response IP | 172.66.40.150 |
| Found | Yes |
| Hash | 38ba8bfef7d526ba7f47c019b03303e50ac2c707207f8c6e3744552c3820b242 |
| SimHash | ed24dea5490a |
Groups
*
*
| Rule | Path |
|---|---|
| Disallow | /_et3/ |
| Disallow | /bootstrap5/ |
| Disallow | /cache/ |
| Disallow | /cgi-bin/ |
| Disallow | /contribute/ |
| Disallow | /discus/messages/ |
| Disallow | /email/ |
| Disallow | /lists/ |
| Disallow | /scripts/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.encyclopedia-titanica.org/sitemap.xml |
| sitemap | https://www.encyclopedia-titanica.org/community/sitemap.php |
| sitemap | https://www.encyclopedia-titanica.org/store/sitemap_index.xml |
| sitemap | https://www.encyclopedia-titanica.org/video-sitemap.xml |
| sitemap | https://www.encyclopedia-titanica.org/video-sitemap.xml |
| sitemap | https://www.encyclopedia-titanica.org/rss.xml |