shock.co
robots.txt

Robots Exclusion Standard data for shock.co

Resource Scan

Scan Details

Site Domain shock.co
Base Domain shock.co
Scan Status Ok
Last Scan2024-06-16T06:06:07+00:00
Next Scan 2024-06-23T06:06:07+00:00

Last Scan

Scanned2024-06-16T06:06:07+00:00
URL https://shock.co/robots.txt
Redirect https://www.shock.co/robots.txt
Redirect Domain www.shock.co
Redirect Base shock.co
Domain IPs 52.10.116.134, 52.24.33.209
Redirect IPs 3.165.102.119, 3.165.102.57, 3.165.102.68, 3.165.102.86
Response IP 3.165.102.86
Found Yes
Hash 4c449a1af8307b9070fd511f566d10d0c5e41e727021e9d5e64cdf5469648887
SimHash 2029d261edb3

Groups

*

Rule Path
Disallow /_track
Disallow /pushnotifications/*
Disallow /instant-articles-ads

grapeshot

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.shock.co/sitemap.xml
sitemap https://www.shock.co/section-sitemap.xml
sitemap https://www.shock.co/tag-sitemap.xml
sitemap https://www.shock.co/content-sitemap.xml
sitemap https://www.shock.co/image-sitemap.xml
sitemap https://www.shock.co/media-sitemap.xml
sitemap https://www.shock.co/author-sitemap-content.xml
sitemap https://www.shock.co/index-sitemap.xml

Warnings

  • 2 invalid lines.