rpggeek.com
robots.txt
Robots Exclusion Standard data for rpggeek.com
Resource Scan
Scan Details
| Site Domain | rpggeek.com |
| Base Domain | rpggeek.com |
| Scan Status | Ok |
| Last Scan | 2025-06-02T10:10:46+00:00 |
| Next Scan | 2025-06-09T10:10:46+00:00 |
Last Scan
| Scanned | 2025-06-02T10:10:46+00:00 |
| URL | https://rpggeek.com/robots.txt |
| Domain IPs | 130.211.47.221 |
| Response IP | 130.211.47.221 |
| Found | Yes |
| Hash | 7241085525ad872c634112e0a8de79621c149b823f82ee11eeb2056a1ab09f48 |
| SimHash | e51ed2418474 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | |
| Allow | / |
| Disallow | /contest |
| Disallow | /wiki/diff/ |
| Disallow | /wiki/diffprev/ |
| Disallow | /wiki/page/*/oldrevid |
| Disallow | /wiki/userhistory* |
| Disallow | /wiki/history |
| Disallow | /wiki/edit |
| Disallow | /wiki/editors |
| Disallow | /wiki/rss |
| Disallow | /*geeklist/*/item/* |
| Disallow | /*geeklist*commentid |
| Disallow | /article |
| Disallow | /thread/*/article/* |
| Disallow | /viewarticle |
| Disallow | /*sk%3D |
| Disallow | /*avatar_ |
| Disallow | /user |
| Disallow | *weblink/* |
| Disallow | /geekbuddy.php |
| Disallow | /geekbuddy |
| Disallow | /geekmail |
| Disallow | /geekrecommend |
| Disallow | /geekbay |
| Disallow | */tag/* |
| Disallow | /geekaffiliate/* |
| Disallow | /tag |
| Disallow | /geektag.php |
| Disallow | /image*size%3D* |
| Disallow | /image/new |
| Disallow | /images/*/all/ |
| Disallow | /metasell |
| Disallow | /fan |
| Disallow | /fans |
| Disallow | /geekstore* |
| Disallow | /trademgr |
| Disallow | /tigris |
| Disallow | /rss/ |
| Disallow | /geeksearch.php |
| Disallow | /file/download |
| Disallow | /jstextad.php |
| Disallow | /jwidget.php |
| Disallow | /forum/search |
| Disallow | /forum/linked |
| Disallow | /graphstats |
| Disallow | /geekads |
| Disallow | /geekmicrobadge |
| Disallow | /geekexchange |
| Disallow | /browse/*?username |
| Disallow | /files/*?username |
| Disallow | */updatesub |
| Disallow | *?commentid |
| Disallow | /comment/quote |
| Disallow | /comment/reply |
| Disallow | */editview |
| Disallow | /geekgold |
| Disallow | /geekauction |
| Disallow | /user/*/interests |
| Disallow | /user/*/geekstuff |
| Disallow | /profile.php?action=search* |
| Disallow | /thread/printerfriendly |
| Disallow | /collection |
| Disallow | /guild/collection |
| Disallow | /geeklist/favorites |
| Disallow | /geeklists/bookmarks |
| Disallow | /geeklist/item/add |
| Disallow | /geeklist/item/delete |
| Disallow | /user/*/recommendations |
| Disallow | /user/*/tags |
| Disallow | /trade |
| Disallow | /play |
| Disallow | /plays |
| Disallow | /thread*username%3D* |
| Disallow | /article*username%3D* |
| Disallow | /item/clone |
| Disallow | /items/*/pending |
| Disallow | /item/create |
| Disallow | /item/correction |
| Disallow | /file/new |
| Disallow | /microbadge |
| Disallow | /answers |
| Disallow | /fans |
| Disallow | /xmlapi |
| Disallow | /geekamazon.php |
| Disallow | /badgeredirect.php |
| Disallow | /geekadmin.php |
| Disallow | /*/module |
| Disallow | /boardgame/*/*/edit |
| Disallow | /geekcollection.php?action=export* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
ai2bot
ai2bot-dolma
amazonbot
anthropic-ai
applebot-extended
brightbot 1.0
bytespider
ccbot
chatglm
chatgpt-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
crawlspace
diffbot
facebookbot
friendlycrawler
google-extended
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
imgproxy
isscyberriskcrawler
kangaroo bot
meta-externalagent
oai-searchbot
omgili
omgilibot
pangubot
perplexity-user
perplexitybot
petalbot
semrushbot-ocob
semrushbot-swa
sidetrade indexer bot
timpibot
velenpublicwebcrawler
webzio-extended
youbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rpggeek.com/sitemapindex |