stocks.us.reuters.com
robots.txt

Robots Exclusion Standard data for stocks.us.reuters.com

Resource Scan

Scan Details

Site Domain stocks.us.reuters.com
Base Domain reuters.com
Scan Status Ok
Last Scan2024-04-13T14:19:59+00:00
Next Scan 2024-05-13T14:19:59+00:00

Last Scan

Scanned2024-04-13T14:19:59+00:00
URL http://stocks.us.reuters.com/robots.txt
Redirect https://www.reuters.com/robots.txt
Redirect Domain www.reuters.com
Redirect Base reuters.com
Domain IPs 155.46.172.254
Redirect IPs 13.225.4.39, 13.225.4.81, 13.225.4.9, 13.225.4.94, 2600:9000:21b4:200:15:5a3e:9d40:93a1, 2600:9000:21b4:2600:15:5a3e:9d40:93a1, 2600:9000:21b4:600:15:5a3e:9d40:93a1, 2600:9000:21b4:7800:15:5a3e:9d40:93a1, 2600:9000:21b4:9200:15:5a3e:9d40:93a1, 2600:9000:21b4:b000:15:5a3e:9d40:93a1, 2600:9000:21b4:d000:15:5a3e:9d40:93a1, 2600:9000:21b4:ee00:15:5a3e:9d40:93a1
Response IP 13.225.4.9
Found Yes
Hash 8cb283c05e40183fb34741baeaae4c475905a1665d7d8a1c23fe022030ad4258
SimHash 9846ba44e536

Groups

piplbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

*

Rule Path
Disallow /finance/stocks/option
Disallow /finance/stocks/financialHighlights
Disallow /search
Disallow /site-search/
Disallow /beta
Disallow /designtech
Disallow /featured-optimize
Disallow /energy-test
Disallow /article/beta
Disallow /sponsored/previewcampaign
Disallow /sponsored/previewarticle
Disallow /test/
Disallow /commentary
Disallow /news/archive/commentary
Disallow /brandfeatures/venture-capital
Disallow /journalists/
Disallow /assets/siteindex
Disallow /article/api/
Disallow /practical-law-the-journal/search/
Disallow /practical-law-the-journal/contributors/
Disallow /fr/

Other Records

Field Value
sitemap https://www.reuters.com/arc/outboundfeeds/sitemap-index/?outputType=xml
sitemap https://www.reuters.com/arc/outboundfeeds/news-sitemap-index/?outputType=xml
sitemap https://www.reuters.com/sitemap_video_index.xml
sitemap https://www.reuters.com/plus/sitemap-index.xml
sitemap https://www.reuters.com/arc/outboundfeeds/sitemap-plj-index/?outputType=xml
sitemap https://www.reuters.com/graphics/sitemap.xml
sitemap https://www.reuters.com/arc/outboundfeeds/sitemap-index/pictures/?outputType=xml

Comments

  • robots.txt for www.reuters.com