shock.co
robots.txt
Robots Exclusion Standard data for shock.co
Resource Scan
Scan Details
Site Domain | shock.co |
Base Domain | shock.co |
Scan Status | Ok |
Last Scan | 2024-09-22T06:10:22+00:00 |
Next Scan | 2024-09-29T06:10:22+00:00 |
Last Scan
Scanned | 2024-09-22T06:10:22+00:00 |
URL | https://shock.co/robots.txt |
Redirect | https://www.shock.co/robots.txt |
Redirect Domain | www.shock.co |
Redirect Base | shock.co |
Domain IPs | 34.208.145.1, 54.68.128.11 |
Redirect IPs | 3.165.102.119, 3.165.102.57, 3.165.102.68, 3.165.102.86 |
Response IP | 3.165.102.68 |
Found | Yes |
Hash | 4c449a1af8307b9070fd511f566d10d0c5e41e727021e9d5e64cdf5469648887 |
SimHash | 2029d261edb3 |
Groups
*
Rule | Path |
---|---|
Disallow | /_track |
Disallow | /pushnotifications/* |
Disallow | /instant-articles-ads |
Other Records
Field | Value |
---|---|
sitemap | https://www.shock.co/sitemap.xml |
sitemap | https://www.shock.co/section-sitemap.xml |
sitemap | https://www.shock.co/tag-sitemap.xml |
sitemap | https://www.shock.co/content-sitemap.xml |
sitemap | https://www.shock.co/image-sitemap.xml |
sitemap | https://www.shock.co/media-sitemap.xml |
sitemap | https://www.shock.co/author-sitemap-content.xml |
sitemap | https://www.shock.co/index-sitemap.xml |
Warnings
- 2 invalid lines.