*
| Rule |
Path |
| Disallow |
/robots.txt |
| Disallow |
/Profiles |
| Disallow |
/Main/Credits |
| Disallow |
/Main/Contact |
| Disallow |
/Main/Latest |
| Disallow |
/Main/LatestUploads |
| Disallow |
/Main/AddGame |
| Disallow |
/Main/Stats |
| Disallow |
/Main/Legal |
| Disallow |
/titles.txt |
| Disallow |
/wiitdb.zip |
| Disallow |
/wiiutdb.zip |
| Disallow |
/*tdb.zip |
| Disallow |
/*tdb.txt |
| Disallow |
/download.php* |
| Disallow |
/*action%3Dtheme* |
accelobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
adidxbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
archive.org_bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
baiduspider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
baiduspider-video
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
baiduspider-image
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
mozilla/5.0 (compatible; baiduspider/2.0; +http://www.baidu.com/search/spider.html)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
mozilla/5.0 (compatible; baiduspider/3.0; +http://www.baidu.com/search/spider.html)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
mozilla/5.0 (compatible; baiduspider/4.0; +http://www.baidu.com/search/spider.html)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
mozilla/5.0 (compatible; baiduspider/5.0; +http://www.baidu.com/search/spider.html)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
baiduspider/2.0
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
baiduspider/3.0
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
baiduspider/4.0
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
baiduspider/5.0
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
bingbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
blekkobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
bountii bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
butterfly
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
daumoa
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
dotbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
duckduckbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
etaospider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
eventgurubot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
ia_archiver
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
alexabot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
verifybot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
ichiro
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
mozilla/5.0 (compatible; linespider/1.1; +https://lin.ee/4dwxkth)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
irlbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
3600 |
| crawl-delay |
30 |
mail.ru
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
meltwater
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
mj12bot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
naverbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
newsnow
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
omgili
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
openindexspider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
picsearch
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
psbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
rogerbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
seekport
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
mozilla/5.0 (compatible; seekport crawler; http://seekport.com/)
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
semrushbot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
shopwiki
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
seznambot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
slurp
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
sogou spider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
sogou web spider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
sosospider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
teoma
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
webvac
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
webzip
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
yandex
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |
yeti
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
yisouspider
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
youdaobot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
30 |
grapeshot
No rules defined. All paths allowed.
Other Records
| Field |
Value |
| crawl-delay |
600 |