boardgamegeek.com
robots.txt
Robots Exclusion Standard data for boardgamegeek.com
Resource Scan
Scan Details
Site Domain | boardgamegeek.com |
Base Domain | boardgamegeek.com |
Scan Status | Ok |
Last Scan | 2024-06-01T00:46:28+00:00 |
Next Scan | 2024-06-08T00:46:28+00:00 |
Last Scan
Scanned | 2024-06-01T00:46:28+00:00 |
URL | https://boardgamegeek.com/robots.txt |
Domain IPs | 130.211.47.221 |
Response IP | 130.211.47.221 |
Found | Yes |
Hash | 2cafdff0cdf8287e1b0dea25b18849c263898ff28953c807d872476c2d94840b |
SimHash | cd1f52458c9a |
Groups
*
Rule | Path |
---|---|
Disallow | |
Allow | / |
Disallow | /contest |
Disallow | /wiki/diff/ |
Disallow | /wiki/diffprev/ |
Disallow | /wiki/page/*/oldrevid |
Disallow | /wiki/userhistory* |
Disallow | /wiki/history |
Disallow | /wiki/edit |
Disallow | /wiki/editors |
Disallow | /wiki/rss |
Disallow | /*geeklist/*/item/* |
Disallow | /*geeklist*commentid |
Disallow | /article |
Disallow | /thread/*/article/* |
Disallow | /viewarticle |
Disallow | /*sk%3D |
Disallow | /*avatar_ |
Disallow | /user |
Disallow | *weblink/* |
Disallow | /geekbuddy.php |
Disallow | /geekbuddy |
Disallow | /geekmail |
Disallow | /geekrecommend |
Disallow | /geekbay |
Disallow | */tag/* |
Disallow | /geekaffiliate/* |
Disallow | /tags |
Disallow | /geektag.php |
Disallow | /image*size%3D* |
Disallow | /image/new |
Disallow | /images/*/all/ |
Disallow | /metasell |
Disallow | /fan |
Disallow | /fans |
Disallow | /geekstore* |
Disallow | /trademgr |
Disallow | /tigris |
Disallow | /rss/ |
Disallow | /geeksearch.php |
Disallow | /spsearch.php |
Disallow | /file/download |
Disallow | /jstextad.php |
Disallow | /jwidget.php |
Disallow | /forum/search |
Disallow | /forum/linked |
Disallow | /graphstats |
Disallow | /geekads |
Disallow | /geekmicrobadge |
Disallow | /geekexchange |
Disallow | /browse/*?username |
Disallow | /files/*?username |
Disallow | */updatesub |
Disallow | *?commentid |
Disallow | /comment/quote |
Disallow | /comment/reply |
Disallow | */editview |
Disallow | /geekgold |
Disallow | /geekauction |
Disallow | /user/*/interests |
Disallow | /user/*/geekstuff |
Disallow | /profile.php?action=search* |
Disallow | /thread/printerfriendly |
Disallow | /collection |
Disallow | /guild/collection |
Disallow | /geeklist/favorites |
Disallow | /geeklists/bookmarks |
Disallow | /geeklist/item/add |
Disallow | /geeklist/item/delete |
Disallow | /user/*/recommendations |
Disallow | /trade |
Disallow | /play |
Disallow | /plays |
Disallow | /thread*username%3D* |
Disallow | /article*username%3D* |
Disallow | /item/clone |
Disallow | /items/*/pending |
Disallow | /item/create |
Disallow | /item/correction |
Disallow | /file/new |
Disallow | /microbadge |
Disallow | /answers |
Disallow | /fans |
Disallow | /xmlapi |
Disallow | /geekamazon.php |
Disallow | /badgeredirect.php |
Disallow | /geekadmin.php |
Disallow | /*/module |
Disallow | /boardgame/*/*/edit |
Disallow | /geekcollection.php?action=export* |
Other Records
Field | Value |
---|---|
crawl-delay | 5 |
Other Records
Field | Value |
---|---|
sitemap | https://boardgamegeek.com/sitemapindex |