vogue.co.jp
robots.txt

Robots Exclusion Standard data for vogue.co.jp

Resource Scan

Scan Details

Site Domain vogue.co.jp
Base Domain vogue.co.jp
Scan Status Ok
Last Scan2024-11-04T03:03:41+00:00
Next Scan 2024-11-11T03:03:41+00:00

Last Scan

Scanned2024-11-04T03:03:41+00:00
URL https://vogue.co.jp/robots.txt
Redirect https://www.vogue.co.jp/robots.txt
Redirect Domain www.vogue.co.jp
Redirect Base vogue.co.jp
Domain IPs 151.101.130.133, 151.101.194.133, 151.101.2.133, 151.101.66.133
Redirect IPs 2600:9000:271a:3400:e:6f0c:4540:93a1, 2600:9000:271a:4200:e:6f0c:4540:93a1, 2600:9000:271a:5200:e:6f0c:4540:93a1, 2600:9000:271a:5800:e:6f0c:4540:93a1, 2600:9000:271a:8c00:e:6f0c:4540:93a1, 2600:9000:271a:8e00:e:6f0c:4540:93a1, 2600:9000:271a:a800:e:6f0c:4540:93a1, 2600:9000:271a:ba00:e:6f0c:4540:93a1, 3.165.82.104, 3.165.82.35, 3.165.82.50, 3.165.82.71
Response IP 3.165.82.104
Found Yes
Hash fab713cce8277d02446a2d40ea036515d9afefda064dfc0ba8b9832bc291204d
SimHash 26189041e271

Groups

*

Rule Path
Disallow /app_dev.php/
Disallow /fno/2014/tokyo/shop/list/
Disallow /item_search/result
Disallow /magazine/subscription/std
Disallow /magazine/subscription/sp
Disallow /preview/
Disallow *?image=
Disallow */image/
Disallow */verso-homepage
Disallow */verso-channel
Disallow */career
Disallow /*?redirectURL=
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=
Disallow /com.condenast/yv8*

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.vogue.co.jp/sitemap.xml
sitemap https://www.vogue.co.jp/feed/google-latest-news/sitemap-google-news
sitemap https://www.vogue.co.jp/feed/rss
sitemap https://www.vogue.co.jp/categories-sitemap.xml
sitemap https://www.vogue.co.jp/contributors-sitemap.xml
sitemap https://www.vogue.co.jp/branded-sitemap.xml
sitemap https://www.vogue.co.jp/bundles-sitemap.xml