wired.jp
robots.txt

Robots Exclusion Standard data for wired.jp

Resource Scan

Scan Details

Site Domain wired.jp
Base Domain wired.jp
Scan Status Ok
Last Scan2024-11-04T17:57:04+00:00
Next Scan 2024-11-11T17:57:04+00:00

Last Scan

Scanned2024-11-04T17:57:04+00:00
URL https://wired.jp/robots.txt
Domain IPs 13.35.238.125, 13.35.238.129, 13.35.238.23, 13.35.238.32, 2600:9000:2085:2000:14:5d65:8e80:93a1, 2600:9000:2085:2a00:14:5d65:8e80:93a1, 2600:9000:2085:400:14:5d65:8e80:93a1, 2600:9000:2085:4800:14:5d65:8e80:93a1, 2600:9000:2085:6800:14:5d65:8e80:93a1, 2600:9000:2085:6c00:14:5d65:8e80:93a1, 2600:9000:2085:e000:14:5d65:8e80:93a1, 2600:9000:2085:f800:14:5d65:8e80:93a1
Response IP 13.35.238.129
Found Yes
Hash cd3a6cbc61ce317f133fd36f27ebf85d46b7b887c8832ec11268a39b478bf27a
SimHash e598d953e633

Groups

*

Rule Path
Disallow /preview/
Disallow /search/
Disallow /*?redirectURL=
Disallow /auth/*
Disallow /account/*
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=
Disallow /com.condenast/yv8*

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://wired.jp/sitemap.xml
sitemap https://wired.jp/feed/google-latest-news/sitemap-google-news
sitemap https://wired.jp/feed/rss
sitemap https://wired.jp/sitemap-wp.xml
sitemap https://wired.jp/contributors-sitemap.xml
sitemap https://wired.jp/categories-sitemap.xml
sitemap https://wired.jp/bundles-sitemap.xml
sitemap https://wired.jp/sitemap-archive-1.xml