Log In Sign Up

csswizardry.com
robots.txt

Robots Exclusion Standard data for csswizardry.com

Resource Scan

Scan Details

Site Domain csswizardry.com
Base Domain csswizardry.com
Scan Status Ok
Last Scan2025-04-17T16:17:48+00:00
Next Scan 2025-05-17T16:17:48+00:00

Last Scan

Scanned2025-04-17T16:17:48+00:00
URL https://csswizardry.com/robots.txt
Domain IPs 104.21.9.92, 172.67.159.186, 2606:4700:3034::ac43:9fba, 2606:4700:3037::6815:95c
Response IP 104.21.9.92
Found Yes
Hash 8e63dc9ca7004e16150754af5484836f9c55dd4192a53c560b1000e589f4a019
SimHash 18dce810c5d6

Groups

*

Rule Path
Allow /

gptbot

Rule Path
Disallow /20*

claudebot

Rule Path
Disallow /20*

bardbot

Rule Path
Disallow /20*

j1bot

Rule Path
Disallow /20*

ccbot

Rule Path
Disallow /20*
Back to top

Other Records

Field Value
sitemap https://csswizardry.com/sitemap.xml
Back to top

Comments

  • Block AI bots from accessing articles for training purposes.
  • This is a little brittle, but it works on the basis that all my blog posts
  • were published at some point in the 21st century.
  • TODO: Update when I’m 109.
Back to top