semicolon.dev
robots.txt

Robots Exclusion Standard data for semicolon.dev

Resource Scan

Scan Details

Site Domain semicolon.dev
Base Domain semicolon.dev
Scan Status Ok
Last Scan2025-11-08T15:30:39+00:00
Next Scan 2025-11-15T15:30:39+00:00

Last Scan

Scanned2025-11-08T15:30:39+00:00
URL https://semicolon.dev/robots.txt
Redirect https://ghosttogether.net/robots.txt
Redirect Domain ghosttogether.net
Redirect Base ghosttogether.net
Domain IPs 172.234.20.104, 2600:3c06::f03c:95ff:febf:8ae6
Redirect IPs 172.234.20.104, 2600:3c06::f03c:95ff:febf:8ae6
Response IP 172.234.20.104
Found Yes
Hash af229b0a1a7e33b7c8d79a8e858eeefb88fd63a72168571d7fd40f7c7ec2d620
SimHash 2d18e3817794

Groups

google
googlebot
twitterbot
twitterbot/1.0
twitterbot

Rule Path
Allow *
Allow /images
Allow /static/
Allow /tutorial
Allow /tutorial/python/