barrons.com
robots.txt
Robots Exclusion Standard data for barrons.com
Resource Scan
Scan Details
| Site Domain | barrons.com |
| Base Domain | barrons.com |
| Scan Status | Ok |
| Last Scan | 2024-09-20T15:35:20+00:00 |
| Next Scan | 2024-09-27T15:35:20+00:00 |
Last Scan
| Scanned | 2024-09-20T15:35:20+00:00 |
| URL | https://barrons.com/robots.txt |
| Redirect | https://www.barrons.com/robots.txt |
| Redirect Domain | www.barrons.com |
| Redirect Base | barrons.com |
| Domain IPs | 13.35.18.10, 13.35.18.120, 13.35.18.30, 13.35.18.31 |
| Redirect IPs | 108.156.133.102, 108.156.133.113, 108.156.133.67, 108.156.133.78, 2600:9000:2755:1600:14:c68f:c40:93a1, 2600:9000:2755:4800:14:c68f:c40:93a1, 2600:9000:2755:5c00:14:c68f:c40:93a1, 2600:9000:2755:9200:14:c68f:c40:93a1, 2600:9000:2755:d600:14:c68f:c40:93a1, 2600:9000:2755:dc00:14:c68f:c40:93a1, 2600:9000:2755:e200:14:c68f:c40:93a1, 2600:9000:2755:ea00:14:c68f:c40:93a1 |
| Response IP | 108.156.133.67 |
| Found | Yes |
| Hash | 996280d91e591a33a15965a7f494c45c99aac57c8be9c39692c48cadfac80d9b |
| SimHash | 19182e4ac490 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /video/search/ |
| Disallow | /market-brief/ |
| Disallow | /auth/ |
| Disallow | /client/login* |
| Disallow | /login?* |
| Disallow | /public/ |
| Disallow | /search?* |
| Disallow | /documents/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.barrons.com/bol_news_sitemap.xml |
| sitemap | https://www.barrons.com/bol_live_news_sitemap.xml |
| sitemap | https://www.barrons.com/sitemaps/web/barrons/en/sitemap_barrons_en_index.xml |
| sitemap | https://www.barrons.com/sitemaps/web/afp_news/en/sitemap_afp_news_en_index.xml |
| sitemap | https://www.barrons.com/sitemaps/web/afp_news/es/sitemap_afp_news_es_index.xml |
| sitemap | https://www.barrons.com/sitemaps/web/barrons_automated/en/sitemap_barrons_automated_en_index.xml |
| sitemap | https://www.barrons.com/sitemaps/web/barrons-video/en/sitemap_barrons-video_en_index.xml |
| sitemap | https://www.barrons.com/sitemap.xml |
| sitemap | https://www.barrons.com/barrons/barrons_quote_index_sitemap.xml |
| sitemap | https://www.barrons.com/finder_sitemap.xml |