seekingalpha.com
robots.txt
Robots Exclusion Standard data for seekingalpha.com
Resource Scan
Scan Details
Site Domain | seekingalpha.com |
Base Domain | seekingalpha.com |
Scan Status | Ok |
Last Scan | 2024-11-03T18:40:58+00:00 |
Next Scan | 2024-11-17T18:40:58+00:00 |
Last Scan
Scanned | 2024-11-03T18:40:58+00:00 |
URL | https://seekingalpha.com/robots.txt |
Domain IPs | 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91, 2a04:4e42:200::347, 2a04:4e42:400::347, 2a04:4e42:600::347, 2a04:4e42::347 |
Response IP | 151.101.1.91 |
Found | Yes |
Hash | 4b1fc0ca965053e84e2c0093bacfa5db80f1f9848cbf0622493dde584ff648f5 |
SimHash | 803c0a466fb1 |
Groups
*
Rule | Path |
---|---|
Disallow | /api/v3/account |
Disallow | /articles/enqueue_tracking |
Disallow | /authentication |
Disallow | /clean |
Disallow | /cloudsearch |
Disallow | /form |
Disallow | /forum |
Disallow | /iphone_data/check_update |
Disallow | /mone |
Disallow | /most-active/*page%3D* |
Disallow | /6001/ |
Disallow | /shark* |
Disallow | /shell |
Disallow | /sloth_files/ |
Disallow | /social/ |
Disallow | /submissions |
Disallow | /market_news/enqueue_tracking |
Disallow | /research/enqueue_tracking |
Disallow | /zuora |
Other Records
Field | Value |
---|---|
sitemap | https://seekingalpha.com/sitemap_news.xml |
sitemap | https://seekingalpha.com/instablog/index.xml |
sitemap | https://seekingalpha.com/news/index.xml |
sitemap | https://seekingalpha.com/article/index.xml |
sitemap | https://seekingalpha.com/author/index.xml |
sitemap | https://seekingalpha.com/checkout/index.xml |
sitemap | https://seekingalpha.com/symbol/sitemap_index.xml |
sitemap | https://seekingalpha.com/evergreen_sitemap.xml |