upworthy.com
robots.txt
Robots Exclusion Standard data for upworthy.com
Resource Scan
Scan Details
Site Domain | upworthy.com |
Base Domain | upworthy.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-06T11:58:07+00:00 |
Next Scan | 2024-05-20T11:58:07+00:00 |
Last Successful Scan
Scanned | 2024-04-21T11:56:59+00:00 |
URL | https://upworthy.com/robots.txt |
Redirect | https://www.upworthy.com/robots.txt |
Redirect Domain | www.upworthy.com |
Redirect Base | upworthy.com |
Domain IPs | 151.101.1.68, 151.101.129.68, 151.101.193.68, 151.101.65.68 |
Redirect IPs | 151.101.1.68, 151.101.129.68, 151.101.193.68, 151.101.65.68 |
Response IP | 199.232.45.68 |
Found | Yes |
Hash | bfc9f4597e0646047731445b6de1f38b7c3a981a6a3d56d46925c54c15b86e8b |
SimHash | 240db4008a92 |
Other Records
Field | Value |
---|---|
sitemap | https://www.upworthy.com/sitemap.xml |