covid19globalstats.com
robots.txt
Robots Exclusion Standard data for covid19globalstats.com
Resource Scan
Scan Details
Site Domain | covid19globalstats.com |
Base Domain | covid19globalstats.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-04-09T16:48:21+00:00 |
Next Scan | 2024-07-08T16:48:21+00:00 |
Last Successful Scan
Scanned | 2022-07-04T02:29:40+00:00 |
URL | https://covid19globalstats.com/robots.txt |
Redirect | https://www.covid19globalstats.com/robots.txt |
Redirect Domain | www.covid19globalstats.com |
Redirect Base | covid19globalstats.com |
Response IP | 74.125.200.121 |
Found | Yes |
Hash | 750e8c72d6763f73534cf0621994e51a6eedf4592283a776f460a1b52431186b |
SimHash | 884ab44ace37 |
Groups
*
Rule | Path |
---|---|
Disallow | /search |
Disallow | /*_archive.html$ |
Disallow | /feeds/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.covid19globalstats.com/sitemap.xml |
sitemap | https://www.covid19globalstats.com/sitemap-pages.xml |
Comments