ersei.net
robots.txt

Robots Exclusion Standard data for ersei.net

Resource Scan

Scan Details

Site Domain ersei.net
Base Domain ersei.net
Scan Status Ok
Last Scan2024-10-03T07:50:27+00:00
Next Scan 2024-10-04T07:50:27+00:00

Last Scan

Scanned2024-10-03T07:50:27+00:00
URL https://ersei.net/robots.txt
Domain IPs 128.210.6.106, 2607:ac80:303:102:638a:ba7f:2013:b0c
Response IP 128.210.6.106
Found Yes
Hash 6d1d27aeb28c7795708f631f76ac2db8eae3f51faf4469342f279c35739fd8ec
SimHash 701e4962e0b4

Groups

*

Rule Path
Disallow /backup/
Disallow /bin/
Disallow /cache/
Disallow /grav/
Disallow /logs/
Disallow /system/
Disallow /vendor/
Disallow /user/
Allow /user/pages/
Allow /user/themes/
Allow /user/images/
Allow /
Allow *.css$
Allow *.js$
Allow /system/*.js$

anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
diffbot
facebookbot
google-extended
gptbot
meta-externalagent
omgili
timpibot

Rule Path
Disallow /