mtlurb.com
robots.txt
Robots Exclusion Standard data for mtlurb.com
Resource Scan
Scan Details
Site Domain | mtlurb.com |
Base Domain | mtlurb.com |
Scan Status | Ok |
Last Scan | 2024-06-12T09:04:46+00:00 |
Next Scan | 2024-06-19T09:04:46+00:00 |
Last Scan
Scanned | 2024-06-12T09:04:46+00:00 |
URL | https://mtlurb.com/robots.txt |
Domain IPs | 18.164.154.19, 18.164.154.49, 18.164.154.76, 18.164.154.86, 2600:9000:24bc:2400:1b:1530:e440:93a1, 2600:9000:24bc:2a00:1b:1530:e440:93a1, 2600:9000:24bc:3200:1b:1530:e440:93a1, 2600:9000:24bc:8200:1b:1530:e440:93a1, 2600:9000:24bc:9a00:1b:1530:e440:93a1, 2600:9000:24bc:b200:1b:1530:e440:93a1, 2600:9000:24bc:b600:1b:1530:e440:93a1, 2600:9000:24bc:ea00:1b:1530:e440:93a1 |
Response IP | 3.160.246.74 |
Found | Yes |
Hash | 56cc26cc621f3460e16ae8c6cdee7be35f877c25713ee7773347eb3352d8eddb |
SimHash | 30707b03849a |
Groups
*
Rule | Path |
---|---|
Disallow | /startTopic/ |
Disallow | /discover/unread/ |
Disallow | /markallread/ |
Disallow | /staff/ |
Disallow | /cookie/ |
Disallow | /online/ |
Disallow | /discover/ |
Disallow | /leaderboard/ |
Disallow | /search/ |
Disallow | /tags/ |
Disallow | /*?advancedSearchForm= |
Disallow | /register/ |
Disallow | /lostpassword/ |
Disallow | /login/ |
Disallow | /*?sortby= |
Disallow | /*?filter= |
Disallow | /*?tab= |
Disallow | /*?do= |
Disallow | /*ref%3D |
Disallow | /*?forumId* |
Disallow | /*?&controller=embed |
Other Records
Field | Value |
---|---|
sitemap | https://mtlurb.com/sitemap.php |
Comments