gochristmas.ca
robots.txt

Robots Exclusion Standard data for gochristmas.ca

Resource Scan

Scan Details

Site Domain gochristmas.ca
Base Domain gochristmas.ca
Scan Status Ok
Last Scan2025-11-23T06:08:18+00:00
Next Scan 2025-12-23T06:08:18+00:00

Last Scan

Scanned2025-11-23T06:08:18+00:00
URL https://gochristmas.ca/robots.txt
Redirect https://www.gochristmas.ca/robots.txt
Redirect Domain www.gochristmas.ca
Redirect Base gochristmas.ca
Domain IPs 34.250.153.99
Redirect IPs 3.160.188.126, 3.160.188.127, 3.160.188.42, 3.160.188.85
Response IP 3.169.71.24
Found Yes
Hash 3f5fbadce974bf73f81ca85d4b6c2b943165f8142fae3e291fd089e98a3c03d8
SimHash 6b68d434e273

Groups

*

Rule Path
Disallow /_hp/
Disallow /artist/
Disallow /searchresults/

Other Records

Field Value
crawl-delay 8

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gochristmas.ca/sitemap.xml

Comments

  • Block OpenAI’s web crawler (GPTBot)
  • Block ChatGPT browsing plugin

Warnings

  • 9 invalid lines.
  • ````` is not a known field.
  • `mozilla/5.0 applewebkit/537.36 (khtml, like gecko); compatible; chatgpt-user/1.0; +https` is not a known field.