thecoli.com
robots.txt
Robots Exclusion Standard data for thecoli.com
Resource Scan
Scan Details
Site Domain | thecoli.com |
Base Domain | thecoli.com |
Scan Status | Ok |
Last Scan | 2024-07-06T14:53:25+00:00 |
Next Scan | 2024-07-13T14:53:25+00:00 |
Last Scan
Scanned | 2024-07-06T14:53:25+00:00 |
URL | https://thecoli.com/robots.txt |
Redirect | https://www.thecoli.com/robots.txt |
Redirect Domain | www.thecoli.com |
Redirect Base | thecoli.com |
Domain IPs | 199.83.128.244, 199.83.134.99 |
Redirect IPs | 45.223.22.201 |
Response IP | 45.223.22.201 |
Found | Yes |
Hash | 8593e5ea7409eac82d73e0d3bb32026545f19e4be1c812f8bee9f18d8015197a |
SimHash | 343b89665369 |
Groups
*
Rule | Path |
---|---|
Disallow | /index.php?members%2F* |
Disallow | /misc/ |
Disallow | /help/ |
Disallow | /search/ |
Disallow | /members/ |
Disallow | /register/ |
Disallow | /login/ |
Disallow | /online/ |
Disallow | /lost-password/ |
Disallow | /recent-activity/ |
Disallow | /account/ |
Disallow | /admin.php |
Disallow | /conversations/ |
Disallow | /events/birthdays/ |
Disallow | /events/monthly |
Disallow | /events/weekly |
Disallow | /find-new/ |
Disallow | /forums/-/ |
Disallow | /forums/tweets/ |
Disallow | /goto/ |
Disallow | /help/ |
Disallow | /login/ |
Disallow | /misc/style?* |
Disallow | /misc/quick-navigation-menu?* |
Disallow | /online/ |
Disallow | /posts/ |
Disallow | /profile-posts/ |
Disallow | /forums/the-race-track.36/ |
Disallow | /forums/just-buggin-out.5/ |
Disallow | /sportsbook/ |
Allow | / |