newsthatmatters.today
robots.txt
Robots Exclusion Standard data for newsthatmatters.today
Resource Scan
Scan Details
Site Domain | newsthatmatters.today |
Base Domain | newsthatmatters.today |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2025-03-19T21:11:16+00:00 |
Next Scan | 2025-06-17T21:11:16+00:00 |
Last Successful Scan
Scanned | 2023-02-06T15:03:10+00:00 |
URL | https://newsthatmatters.today/robots.txt |
Domain IPs | 104.21.18.212, 172.67.183.95, 2606:4700:3030::ac43:b75f, 2606:4700:3033::6815:12d4 |
Response IP | 172.67.183.95 |
Found | Yes |
Hash | e158b4d23286e6936c2dcba9a2bf0be8cc5f1fd623d024be19e2464500a12e6f |
SimHash | 290c58008993 |
Other Records
Field | Value |
---|---|
sitemap | https://newsthatmatters.today/sitemap.xml |