entertainment.digitaltrends.com
robots.txt
Robots Exclusion Standard data for entertainment.digitaltrends.com
Resource Scan
Scan Details
Site Domain | entertainment.digitaltrends.com |
Base Domain | digitaltrends.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-03-26T10:47:00+00:00 |
Next Scan | 2024-05-25T10:47:00+00:00 |
Last Successful Scan
Scanned | 2024-01-26T19:46:55+00:00 |
URL | https://entertainment.digitaltrends.com/robots.txt |
Domain IPs | 104.18.2.63, 104.18.3.63, 2606:4700::6812:23f, 2606:4700::6812:33f |
Response IP | 104.18.3.63 |
Found | Yes |
Hash | f1b8b68e8c9e9b829ab87f37c9fa5b3881ea4e02ee0917c113f35604b2e0d575 |
SimHash | 61041b60c713 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Other Records
Field | Value |
---|---|
sitemap | https://www.entertainment.digitaltrends.com/sitemap.xml |