yahoo-mbga.jp
robots.txt

Robots Exclusion Standard data for yahoo-mbga.jp

Archived Snapshots

Resource Scan

Scan Details

Site Domain	yahoo-mbga.jp
Base Domain	yahoo-mbga.jp
Scan Status	Ok
Last Scan	2024-09-21T14:52:24+00:00
Next Scan	2024-09-28T14:52:24+00:00

Last Scan

Scanned	2024-09-21T14:52:24+00:00
URL	https://yahoo-mbga.jp/robots.txt
Domain IPs	52.197.229.141, 52.69.208.6
Response IP	52.69.208.6
Found	Yes
Hash	00dfec6e49321e995b05a9a3ed85d3d4c4bc1e4487a737cc63761717a821fb0e
SimHash	8b4776a085aa

Groups

appie

Rule	Path
Disallow	/

Rule

Path

Disallow

naverrobot

Rule	Path
Disallow	/

Rule

Path

Disallow

gaisbot

Rule	Path
Disallow	/

Rule

Path

Disallow

girafabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

indexpert

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww-perl

Rule	Path
Disallow	/

Rule

Path

Disallow

linkwalker

Rule	Path
Disallow	/

Rule

Path

Disallow

momspider

Rule	Path
Disallow	/

Rule

Path

Disallow

pockey-gethtml

Rule	Path
Disallow	/

Rule

Path

Disallow

rico

Rule	Path
Disallow	/

Rule

Path

Disallow

scooter

Rule	Path
Disallow	/

Rule

Path

Disallow

vspider

Rule	Path
Disallow	/

Rule

Path

Disallow

webauto

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/
Allow	/sitemap
Allow	/ads.txt
Allow	/$
Allow	/?
Allow	/avatar
Allow	/famous
Allow	/game
Allow	/stdgame
Allow	/friendaff
Allow	/help
Allow	/page
Allow	/cpn
Allow	/campaign
Allow	/group$
Allow	/group?
Allow	/group/category
Allow	/8614574$
Allow	/8614574?
Allow	/8614574/diary$
Allow	/8614574/diary?
Allow	/25000036$
Allow	/25000036?
Allow	/25000036/diary$
Allow	/25000036/diary?
Allow	/25000045$
Allow	/25000045?
Allow	/25000045/diary$
Allow	/25000045/diary?
Allow	/25000053$
Allow	/25000053?
Allow	/25000053/diary$
Allow	/25000053/diary?
Allow	/25000054$
Allow	/25000054?
Allow	/25000054/diary$
Allow	/25000054/diary?
Allow	/25000061$
Allow	/25000061?
Allow	/25000061/diary$
Allow	/25000061/diary?
Allow	/25000066$
Allow	/25000066?
Allow	/25000066/diary$
Allow	/25000066/diary?
Allow	/25000082$
Allow	/25000082?
Allow	/25000082/diary$
Allow	/25000082/diary?
Allow	/25000084$
Allow	/25000084?
Allow	/25000084/diary$
Allow	/25000084/diary?
Allow	/25000224$
Allow	/25000224?
Allow	/25000224/diary$
Allow	/25000224/diary?
Allow	/25000229$
Allow	/25000229?
Allow	/25000229/diary$
Allow	/25000229/diary?
Allow	/25000238$
Allow	/25000238?
Allow	/25000238/diary$
Allow	/25000238/diary?
Allow	/25000252$
Allow	/25000252?
Allow	/25000252/diary$
Allow	/25000252/diary?
Allow	/25000259$
Allow	/25000259?
Allow	/25000259/diary$
Allow	/25000259/diary?
Allow	/25000261$
Allow	/25000261?
Allow	/25000261/diary$
Allow	/25000261/diary?
Allow	/25000262$
Allow	/25000262?
Allow	/25000262/diary$
Allow	/25000262/diary?
Allow	/25000264$
Allow	/25000264?
Allow	/25000264/diary$
Allow	/25000264/diary?
Allow	/25000265$
Allow	/25000265?
Allow	/25000265/diary$
Allow	/25000265/diary?
Allow	/25000266$
Allow	/25000266?
Allow	/25000266/diary$
Allow	/25000266/diary?
Allow	/25000267$
Allow	/25000267?
Allow	/25000267/diary$
Allow	/25000267/diary?
Allow	/25000268$
Allow	/25000268?
Allow	/25000268/diary$
Allow	/25000268/diary?
Allow	/25000269$
Allow	/25000269?
Allow	/25000269/diary$
Allow	/25000269/diary?
Allow	/25000270$
Allow	/25000270?
Allow	/25000270/diary$
Allow	/25000270/diary?
Allow	/25000271$
Allow	/25000271?
Allow	/25000271/diary$
Allow	/25000271/diary?
Allow	/25000272$
Allow	/25000272?
Allow	/25000272/diary$
Allow	/25000272/diary?
Allow	/25000273$
Allow	/25000273?
Allow	/25000273/diary$
Allow	/25000273/diary?
Allow	/25000276$
Allow	/25000276?
Allow	/25000276/diary$
Allow	/25000276/diary?
Allow	/25000278$
Allow	/25000278?
Allow	/25000278/diary$
Allow	/25000278/diary?
Allow	/25000279$
Allow	/25000279?
Allow	/25000279/diary$
Allow	/25000279/diary?
Allow	/25000280$
Allow	/25000280?
Allow	/25000280/diary$
Allow	/25000280/diary?
Allow	/25000281$
Allow	/25000281?
Allow	/25000281/diary$
Allow	/25000281/diary?
Allow	/25000283$
Allow	/25000283?
Allow	/25000283/diary$
Allow	/25000283/diary?
Allow	/30100819$
Allow	/30100819?
Allow	/30100819/diary$
Allow	/30100819/diary?

Rule

Path

Disallow

Allow

/sitemap

Allow

/ads.txt

Allow

/avatar

Allow

/famous

Allow

/game

Allow

/stdgame

Allow

/friendaff

Allow

/help

Allow

/page

Allow

/cpn

Allow

/campaign

Allow

/group$

Allow

/group?

Allow

/group/category

Allow

/8614574$

Allow

/8614574?

Allow

/8614574/diary$

Allow

/8614574/diary?

Allow

/25000036$

Allow

/25000036?

Allow

/25000036/diary$

Allow

/25000036/diary?

Allow

/25000045$

Allow

/25000045?

Allow

/25000045/diary$

Allow

/25000045/diary?

Allow

/25000053$

Allow

/25000053?

Allow

/25000053/diary$

Allow

/25000053/diary?

Allow

/25000054$

Allow

/25000054?

Allow

/25000054/diary$

Allow

/25000054/diary?

Allow

/25000061$

Allow

/25000061?

Allow

/25000061/diary$

Allow

/25000061/diary?

Allow

/25000066$

Allow

/25000066?

Allow

/25000066/diary$

Allow

/25000066/diary?

Allow

/25000082$

Allow

/25000082?

Allow

/25000082/diary$

Allow

/25000082/diary?

Allow

/25000084$

Allow

/25000084?

Allow

/25000084/diary$

Allow

/25000084/diary?

Allow

/25000224$

Allow

/25000224?

Allow

/25000224/diary$

Allow

/25000224/diary?

Allow

/25000229$

Allow

/25000229?

Allow

/25000229/diary$

Allow

/25000229/diary?

Allow

/25000238$

Allow

/25000238?

Allow

/25000238/diary$

Allow

/25000238/diary?

Allow

/25000252$

Allow

/25000252?

Allow

/25000252/diary$

Allow

/25000252/diary?

Allow

/25000259$

Allow

/25000259?

Allow

/25000259/diary$

Allow

/25000259/diary?

Allow

/25000261$

Allow

/25000261?

Allow

/25000261/diary$

Allow

/25000261/diary?

Allow

/25000262$

Allow

/25000262?

Allow

/25000262/diary$

Allow

/25000262/diary?

Allow

/25000264$

Allow

/25000264?

Allow

/25000264/diary$

Allow

/25000264/diary?

Allow

/25000265$

Allow

/25000265?

Allow

/25000265/diary$

Allow

/25000265/diary?

Allow

/25000266$

Allow

/25000266?

Allow

/25000266/diary$

Allow

/25000266/diary?

Allow

/25000267$

Allow

/25000267?

Allow

/25000267/diary$

Allow

/25000267/diary?

Allow

/25000268$

Allow

/25000268?

Allow

/25000268/diary$

Allow

/25000268/diary?

Allow

/25000269$

Allow

/25000269?

Allow

/25000269/diary$

Allow

/25000269/diary?

Allow

/25000270$

Allow

/25000270?

Allow

/25000270/diary$

Allow

/25000270/diary?

Allow

/25000271$

Allow

/25000271?

Allow

/25000271/diary$

Allow

/25000271/diary?

Allow

/25000272$

Allow

/25000272?

Allow

/25000272/diary$

Allow

/25000272/diary?

Allow

/25000273$

Allow

/25000273?

Allow

/25000273/diary$

Allow

/25000273/diary?

Allow

/25000276$

Allow

/25000276?

Allow

/25000276/diary$

Allow

/25000276/diary?

Allow

/25000278$

Allow

/25000278?

Allow

/25000278/diary$

Allow

/25000278/diary?

Allow

/25000279$

Allow

/25000279?

Allow

/25000279/diary$

Allow

/25000279/diary?

Allow

/25000280$

Allow

/25000280?

Allow

/25000280/diary$

Allow

/25000280/diary?

Allow

/25000281$

Allow

/25000281?

Allow

/25000281/diary$

Allow

/25000281/diary?

Allow

/25000283$

Allow

/25000283?

Allow

/25000283/diary$

Allow

/25000283/diary?

Allow

/30100819$

Allow

/30100819?

Allow

/30100819/diary$

Allow

/30100819/diary?

Other Records

Field	Value
sitemap	http://yahoo-mbga.jp/sitemap_index.xml.gz

Field

Value

sitemap

http://yahoo-mbga.jp/sitemap_index.xml.gz

yahoo-mbga.jprobots.txt

Resource Scan

Scan Details

Last Scan

Groups

appie

naverrobot

gaisbot

girafabot

ia_archiver

indexpert

libwww-perl

linkwalker

momspider

pockey-gethtml

rico

scooter

vspider

webauto

*

Other Records

yahoo-mbga.jp
robots.txt