comscoredatamine.com
robots.txt
Robots Exclusion Standard data for comscoredatamine.com
Resource Scan
Scan Details
| Site Domain | comscoredatamine.com |
| Base Domain | comscoredatamine.com |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Couldn't connect to server. |
| Last Scan | 2024-10-11T23:07:02+00:00 |
| Next Scan | 2025-01-09T23:07:02+00:00 |
Last Successful Scan
| Scanned | 2022-11-29T03:47:37+00:00 |
| URL | http://comscoredatamine.com/robots.txt |
| Redirect | https://www.comscore.com/robots.txt |
| Redirect Domain | www.comscore.com |
| Redirect Base | comscore.com |
| Response IP | 13.227.254.2, 13.227.254.89, 13.227.254.46, 13.227.254.47 |
| Found | Yes |
| Hash | 0c232fd8d0d8c4fec8d627b238a38b6ca805a7aa80d7d1cec83620932755da28 |
| SimHash | 9451d8725d92 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /request/ |
| Disallow | /*/request/ |
| Disallow | /drafts/ |
| Disallow | /*/drafts/ |
| Disallow | /rss_items/ |
| Disallow | /*/rss_items/ |
| Disallow | /redirects/ |
| Disallow | /*/redirects/ |
| Disallow | /cmr/ |
| Disallow | /*/cmr/ |
| Disallow | /layout/set/popup/ |
| Disallow | /*/layout/set/popup/ |
| Disallow | /*.pdf$ |
| Disallow | /rus$ |
| Disallow | /dut$ |
| Disallow | /rus/* |
| Disallow | /dut/* |
| Disallow | /Request/ |
| Disallow | /*/Request/ |
| Disallow | /Drafts/ |
| Disallow | /*/Drafts/ |
| Disallow | /Rss_items/ |
| Disallow | /*/Rss_items/ |
| Disallow | /Redirects/ |
| Disallow | /*/Redirects/ |
| Disallow | /Cmr/ |
| Disallow | /*/Cmr/ |
| Disallow | /Layout/set/popup/ |
| Disallow | /*/Layout/set/popup/ |
| Disallow | /*.Pdf$ |
| Disallow | /Rus$ |
| Disallow | /Dut$ |
| Disallow | /Rus/* |
| Disallow | /Dut/* |