datasift.com
robots.txt
Robots Exclusion Standard data for datasift.com
Resource Scan
Scan Details
| Site Domain | datasift.com |
| Base Domain | datasift.com |
| Scan Status | Failed |
| Failure Reason | Scan timed out. |
| Last Scan | 2024-05-25T09:42:05+00:00 |
| Next Scan | 2024-08-23T09:42:05+00:00 |
Last Successful Scan
| Scanned | 2022-10-17T13:11:51+00:00 |
| URL | http://datasift.com/robots.txt |
| Redirect | https://www.meltwater.com/robots.txt |
| Redirect Domain | www.meltwater.com |
| Redirect Base | meltwater.com |
| Response IP | 76.76.21.142, 76.76.21.93 |
| Found | Yes |
| Hash | f74fd33ff007a5f8e820bf151fe53f4fe029fd8213244a490ae595ad9b197926 |
| SimHash | 0844d850c113 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.meltwater.com/sitemap.xml |