khronos.org
robots.txt

Robots Exclusion Standard data for khronos.org

Resource Scan

Scan Details

Site Domain khronos.org
Base Domain khronos.org
Scan Status Ok
Last Scan2024-06-17T21:44:27+00:00
Next Scan 2024-07-01T21:44:27+00:00

Last Scan

Scanned2024-06-17T21:44:27+00:00
URL https://khronos.org/robots.txt
Redirect https://www.khronos.org/robots.txt
Redirect Domain www.khronos.org
Redirect Base khronos.org
Domain IPs 104.236.24.254
Redirect IPs 104.236.24.254
Response IP 104.236.24.254
Found Yes
Hash 25512dc08584f8d2ca9698dd082c57a7ebdc0c287d95dda830300a4a77fbafee
SimHash 541cf952e2a8

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /registrant/
Disallow /cms_registrations/
Disallow /webcl/wiki_webcl/
Disallow /members/login/
Disallow /api/
Disallow /webgl/wiki_1_15/
Disallow /webgl/wiki/Special%3ASearch
Disallow /webgl/wiki/Special%3ARandom

adsbot-google
amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claudebot/1.0
claude-web
dotbot
cohere-ai
dataforseobot
facebookbot
friendlycrawler
google-extended
googleother
gptbot
img2dataset
imagesiftbot
magpie-crawler
meltwater
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
piplbot
seekr
youbot
mediatoolkitbot
ahrefsbot
riddler
semrushbot-sa
ntentbot
mj12bot
mojeekbot
flamingo_searchengine
adsbot-google-mobile
adsbot-google-mobile-apps

Rule Path
Disallow /

Warnings

  • 1 invalid line.