ccjdigital.com
robots.txt

Robots Exclusion Standard data for ccjdigital.com

Resource Scan

Scan Details

Site Domain ccjdigital.com
Base Domain ccjdigital.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-29T01:31:10+00:00
Next Scan 2025-01-27T01:31:10+00:00

Last Successful Scan

Scanned2023-10-05T23:57:46+00:00
URL https://ccjdigital.com/robots.txt
Redirect https://www.ccjdigital.com/robots.txt
Redirect Domain www.ccjdigital.com
Redirect Base ccjdigital.com
Domain IPs 89.106.200.1
Redirect IPs 18.224.154.182, 3.128.143.251, 3.137.36.211
Response IP 18.224.154.182
Found Yes
Hash 35c31fb1956f3003445c541ca301de942e306027d4ac8df8bed7272338bce424
SimHash 5805b8682b13

Groups

*

Rule Path
Disallow /__
Disallow /print/content
Disallow /search

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ccjdigital.com/sitemap.xml
sitemap https://www.ccjdigital.com/sitemap-google-news.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449