wired.me
robots.txt
Robots Exclusion Standard data for wired.me
Resource Scan
Scan Details
| Site Domain | wired.me |
| Base Domain | wired.me |
| Scan Status | Ok |
| Last Scan | 2026-04-02T09:03:54+00:00 |
| Next Scan | 2026-04-09T09:03:54+00:00 |
Last Scan
| Scanned | 2026-04-02T09:03:54+00:00 |
| URL | https://wired.me/robots.txt |
| Domain IPs | 2600:9000:2721:1400:9:5a:4e80:93a1, 2600:9000:2721:200:9:5a:4e80:93a1, 2600:9000:2721:4200:9:5a:4e80:93a1, 2600:9000:2721:6800:9:5a:4e80:93a1, 2600:9000:2721:8000:9:5a:4e80:93a1, 2600:9000:2721:a400:9:5a:4e80:93a1, 2600:9000:2721:c000:9:5a:4e80:93a1, 2600:9000:2721:d000:9:5a:4e80:93a1, 3.165.102.102, 3.165.102.35, 3.165.102.42, 3.165.102.54 |
| Response IP | 3.165.102.35 |
| Found | Yes |
| Hash | c577ed746bec0bada088437741f956ffb30c9c1113bd33ab5dce8582d0e87d7a |
| SimHash | 9c950393ceb7 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Allow | /*?*page |
| Allow | /*.xml? |
| Allow | /*.js |
| Allow | /*.css |
| Allow | /*.ico |
| Allow | /verso/static |
| Allow | /*.svg |
| Allow | /*.png |
| Allow | /*.jpg |
| Allow | /*.jpeg |
| Allow | /*rss? |
| Allow | /*?id= |
| Disallow | /auth/ |
| Disallow | /account/ |
| Disallow | /user/ |
| Disallow | /user-context |
| Disallow | /preview/ |
| Disallow | /search |
| Disallow | /product/ |
| Disallow | /cdn-cgi/ |
| Disallow | /services.min.js |
| Disallow | /com.condenast/yv8 |
facebookexternalhit
twitterbot
pinterestbot
linkedinbot
tiktokspider
storebot-google
google-inspectiontool
| Rule | Path |
|---|---|
| Allow | / |
google-extended
google-cloudvertexbot
googleother
applebot-extended
amazonbot
meta-webindexer
meta-externalagent
meta-externalfetcher
claudebot
claude-searchbot
claude-user
perplexitybot
perplexity-user
cohere-training-data-crawler
cohere-ai
ccbot
pangubot
petalbot
bytespider
diffbot
duckassistbot
mistralai-user
timpibot
webzio
webzio-extended
archive.org_bot
ia_archiver
ia_archiver-web.archive.org
heritrix
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.wired.me/sitemap.xml |
| sitemap | https://www.wired.me/tagpages-sitemap.xml |
| sitemap | https://www.wired.me/contributors-sitemap.xml |
| sitemap | https://www.wired.me/bundles-sitemap.xml |
| sitemap | https://www.wired.me/branded-sitemap.xml |
| sitemap | https://www.wired.me/feed/google-latest-news/sitemap-google-news |
| sitemap | https://www.wired.me/feed/rss |