faq.sc.mufg.jp
robots.txt

Robots Exclusion Standard data for faq.sc.mufg.jp

Resource Scan

Scan Details

Site Domain faq.sc.mufg.jp
Base Domain mufg.jp
Scan Status Ok
Last Scan2025-05-11T02:47:54+00:00
Next Scan 2025-06-10T02:47:54+00:00

Last Scan

Scanned2025-05-11T02:47:54+00:00
URL https://faq.sc.mufg.jp/robots.txt
Domain IPs 124.146.171.25
Response IP 124.146.171.25
Found Yes
Hash 3d44c960fe71410f2086057f5a0820277e53c621e8d1defa174b7ed65ae8a987
SimHash 53154041f678

Groups

*

Rule Path
Disallow /usr/
Disallow /tmp/
Disallow /category/search
Allow /usr/favicon/images/
Allow /usr/ogp/images/

bubing

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

icc-crawler

Rule Path
Disallow /

brightedge

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bingbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
sitemap http:///sitemap.xml