braingle.com
robots.txt
Robots Exclusion Standard data for braingle.com
Resource Scan
Scan Details
| Site Domain | braingle.com |
| Base Domain | braingle.com |
| Scan Status | Ok |
| Last Scan | 2024-11-12T22:30:49+00:00 |
| Next Scan | 2024-11-19T22:30:49+00:00 |
Last Scan
| Scanned | 2024-11-12T22:30:49+00:00 |
| URL | https://braingle.com/robots.txt |
| Redirect | https://www.braingle.com/robots.txt |
| Redirect Domain | www.braingle.com |
| Redirect Base | braingle.com |
| Domain IPs | 104.21.68.234, 172.67.199.134, 2606:4700:3035::6815:44ea, 2606:4700:3035::ac43:c786 |
| Redirect IPs | 104.21.68.234, 172.67.199.134, 2606:4700:3035::6815:44ea, 2606:4700:3035::ac43:c786 |
| Response IP | 172.67.199.134 |
| Found | Yes |
| Hash | 75443c9a091741f4221ed86690a35e63b77cd011c66ff1709fd3772335914856 |
| SimHash | c65458604edd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /ads/* |
| Disallow | /store |
| Disallow | /login.php |
| Disallow | /games/chess/game.php |
| Disallow | /games/chess/user.php |
| Disallow | /games/checkers/game.php |
| Disallow | /games/checkers/user.php |
| Disallow | /games/animal/index.php |
| Disallow | /games/summary.php |
| Disallow | /games/cardgames/search.php |
| Disallow | /trivia/search_results.php |
| Disallow | /trivia/search.php |
| Disallow | /trivia/art.php |
| Disallow | /trivia/famous.php |
| Disallow | /brainteasers/search_results.php |
| Disallow | /brainteasers/search.php |
| Disallow | /mind/search_results.php |
| Disallow | /mind/search.php |
| Disallow | /community/private_messages.php |
| Disallow | /community/view.php |
| Disallow | /community/user_rss.php |
| Disallow | /community/rankings.php |
| Disallow | /community/wiki.php |
| Disallow | /community/board_searchall.php |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.braingle.com/sitemap_index.php |