urbanplanet.org
robots.txt
Robots Exclusion Standard data for urbanplanet.org
Resource Scan
Scan Details
| Site Domain | urbanplanet.org |
| Base Domain | urbanplanet.org |
| Scan Status | Ok |
| Last Scan | 2024-11-11T13:37:02+00:00 |
| Next Scan | 2024-11-18T13:37:02+00:00 |
Last Scan
| Scanned | 2024-11-11T13:37:02+00:00 |
| URL | https://urbanplanet.org/robots.txt |
| Redirect | https://forum.urbanplanet.org/robots.txt |
| Redirect Domain | forum.urbanplanet.org |
| Redirect Base | urbanplanet.org |
| Domain IPs | 104.26.14.16, 104.26.15.16, 172.67.69.236, 2606:4700:20::681a:e10, 2606:4700:20::681a:f10, 2606:4700:20::ac43:45ec |
| Redirect IPs | 104.26.14.16, 104.26.15.16, 172.67.69.236, 2606:4700:20::681a:e10, 2606:4700:20::681a:f10, 2606:4700:20::ac43:45ec |
| Response IP | 104.26.14.16 |
| Found | Yes |
| Hash | 316316b91a346dda949f4e4bc606defcb62632a9b17ac2a76474974e879ec95b |
| SimHash | 30306a01049a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /startTopic/ |
| Disallow | /discover/unread/ |
| Disallow | /markallread/ |
| Disallow | /staff/ |
| Disallow | /cookie/ |
| Disallow | /online/ |
| Disallow | /discover/ |
| Disallow | /leaderboard/ |
| Disallow | /search/ |
| Disallow | /tags/ |
| Disallow | /*?advancedSearchForm= |
| Disallow | /register/ |
| Disallow | /lostpassword/ |
| Disallow | /login/ |
| Disallow | /*?sortby= |
| Disallow | /*?filter= |
| Disallow | /*?tab= |
| Disallow | /*?do= |
| Disallow | /*ref%3D |
| Disallow | /*?forumId* |
| Disallow | /*?&controller=embed |
Other Records
| Field | Value |
|---|---|
| sitemap | https://forum.urbanplanet.org/sitemap.php |
Comments