hotwired.com
robots.txt

Robots Exclusion Standard data for hotwired.com

Resource Scan

Scan Details

Site Domain hotwired.com
Base Domain hotwired.com
Scan Status Ok
Last Scan2024-11-13T04:17:09+00:00
Next Scan 2024-11-20T04:17:09+00:00

Last Scan

Scanned2024-11-13T04:17:09+00:00
URL http://hotwired.com/robots.txt
Redirect https://www.wired.com/robots.txt
Redirect Domain www.wired.com
Redirect Base wired.com
Domain IPs 3.222.163.76
Redirect IPs 18.155.68.26, 18.155.68.6, 18.155.68.77, 18.155.68.79, 2600:9000:23d2:200:14:11ee:9340:93a1, 2600:9000:23d2:5400:14:11ee:9340:93a1, 2600:9000:23d2:5e00:14:11ee:9340:93a1, 2600:9000:23d2:6c00:14:11ee:9340:93a1, 2600:9000:23d2:8200:14:11ee:9340:93a1, 2600:9000:23d2:8800:14:11ee:9340:93a1, 2600:9000:23d2:8a00:14:11ee:9340:93a1, 2600:9000:23d2:e200:14:11ee:9340:93a1
Response IP 18.155.68.79
Found Yes
Hash a213f3cfc6ffb173f6d771c573f56f0fe5721290823f37347e2716353fc1d952
SimHash c10a41446766

Groups

*

Rule Path
Disallow /*?redirectURL=
Disallow /*/amp
Disallow /cgi-bin/
Disallow /user/
Disallow /templatedata/
Disallow /partnerfeeds/
Disallow /magazine/polls/
Disallow /services/emailFriend
Disallow /politics/law/news/2001/12/48946
Disallow /politics/law/news/2001/12/49013
Disallow /politics/law/news/2001/12/49083
Disallow /politics/law/news/2001/12/49141
Disallow /politics/law/news/2002/03/51042
Disallow /politics/law/news/2001/12/48938
Disallow /politics/law/news/2001/12/48940
Disallow /politics/law/news/2001/12/48943
Disallow /politics/law/news/2001/12/49013
Disallow /politics/law/news/2001/12/48929
Disallow /politics/law/news/2001/12/48938
Disallow /politics/law/news/2001/12/48940
Disallow /politics/law/news/2001/12/48941
Disallow /politics/law/news/2001/12/48942
Disallow /politics/law/news/2001/12/48943
Disallow /news/politics/0%2C1283%2C48946%2C00.html
Disallow /news/politics/0%2C1283%2C49132%2C00.html
Disallow /news/politics/0%2C48940-0.html
Disallow /news/politics/1%2C49013-0.html
Disallow /culture/lifestyle/news/2001/07/45247
Disallow /culture/lifestyle/news/2001/02/41846
Disallow /2001/07/dying-for-attention/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/plugins/
Disallow /wp-content/cache/
Disallow /wp-content/themes/
Disallow /search
Disallow /culture/lifestyle/news/2001/08/46315
Disallow /2001/08/gruesome-movie-sparks-outrage/
Disallow /techbiz/media/news/2001/09/46556
Disallow /2001/09/controversial-shock-site-for-sale/
Disallow /2007/07/fbi-spyware-how/
Disallow /partners/
Disallow /sponsored/
Disallow /video/right_rail*
Disallow /auth/*
Disallow /account/*
Disallow /preview/
Allow /wp-content/
Allow /wp-content/themes/Phoenix/assets/css/style.css
Allow /wp-content/themes/Phoenix/assets/css/hf.css
Allow /wp-content/themes/Phoenix/assets/images/apple-touch-icon.png
Allow /wp-content/themes/Phoenix/assets/images/
Allow /wp-content/themes/wired/assets/images/gallery-cam%402x.png
Allow /wp-content/themes/wired/assets/images/subscribe_290x110.gif
Allow /wp-content/themes/wired/assets/images/wired_insider_1118_1000x190.jpg
Allow /wp-content/themes/wired/assets/images/subscribe_1000x190.gif
Allow /wp-content/themes/wired/assets/images/post_wired_logo_150x60.gif
Allow /wp-content/themes/wired/assets/images/wired_video_1000x190.jpg
Allow /wp-content/themes/wired/assets/images/subscribe_310x80.gif
Allow /wp-content/themes/wired/assets/images/disruptive_by_design_2012.gif
Allow /wp-content/themes/wired/assets/images/gallery-illo%402x.png
Allow /wp-content/themes/Phoenix/assets/js/vendor/picturefill.min.js
Allow /wp-content/themes/Phoenix/assets/images/apple-touch-icon.png
Allow /wp-content/themes/Phoenix/assets/images/nav-icons-dist/sprite-2-25.png
Allow /wp-content/themes/Phoenix/assets/images/rad-fallback/fallback-short.jpg
Allow /wp-content/themes/Phoenix/assets/images/rad-fallback/fallback-tall-b.jpg
Allow /wp-includes/js/wp-emoji-release.min.js
Allow /wp-includes/js/wp-emoji-release.min.js?ver=4.5.2
Allow /wp-content/themes/Phoenix/assets/css/cyphon.css
Allow /wp-content/plugins/feature-story-builder/builder-frontend/assets/css/fsb.css
Allow /wp-includes/js/mediaelement/mediaelementplayer.min.css
Allow /wp-includes/js/mediaelement/wp-mediaelement.min.css
Allow /wp-content/themes/Phoenix/assets/css/exchange.css
Allow /wp-content/themes/Phoenix/assets/css/wired-blank-canvas.css
Allow /wp-content/plugins/google-to-table/css/google-to-table.css
Allow /wp-content/plugins/feature-story-builder/builder-frontend/assets/images/arrow.png
Allow /wp-content/plugins/feature-story-builder/builder-frontend/assets/images/footer-wired.png
Allow /wp-content/plugins/feature-story-builder/builder-frontend/assets/images/logo-w.png
Allow /wp-content/plugins/feature-story-builder/builder-frontend/assets/images/w.png
Allow /wp-includes/js/mediaelement/mediaelementplayer.min.css
Allow /wp-includes/js/mediaelement/wp-mediaelement.min.css
Allow /partners/bnymellon/futureofmoney/images
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=
Disallow /com.condenast/yv8*

googlebot

Rule Path
Allow /*/amp
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /search
Disallow /*?redirectURL=
Disallow /auth/*
Disallow /account/*
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=
Disallow /preview/

bingbot

Rule Path
Allow /*/amp
Disallow /*%7B%7Burl%7D%7D
Disallow /*%7B%7Burl%7D%7D
Disallow /search
Disallow /*?redirectURL=
Disallow /auth/*
Disallow /account/*
Disallow /*%7B%7Bsection%7D%7D
Disallow /*%7B%7Bsection%7D%7D
Disallow /product/
Disallow /user-context?referrer
Disallow /services.min.js?_=

google-inspectiontool

Rule Path
Allow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wired.com/sitemap.xml
sitemap https://www.wired.com/branded-sitemap.xml
sitemap https://www.wired.com/video/sitemap.xml
sitemap https://www.wired.com/feed/google-latest-news/sitemap-google-news
sitemap https://www.wired.com/feed/rss
sitemap https://www.wired.com/contributors-sitemap.xml
sitemap https://www.wired.com/categories-sitemap.xml?hierarchy=tags
sitemap https://www.wired.com/sitemap-archive-1.xml
sitemap https://www.wired.com/bundles-sitemap.xml

Comments

  • Sitemap: https://www.wired.com/coupons/sitemap.xml
  • Sitemap: https://www.wired.com/categories-sitemap.xml