khronos.org
robots.txt

Robots Exclusion Standard data for khronos.org

Resource Scan

Scan Details

Site Domain khronos.org
Base Domain khronos.org
Scan Status Ok
Last Scan2024-06-03T21:44:01+00:00
Next Scan 2024-06-17T21:44:01+00:00

Last Scan

Scanned2024-06-03T21:44:01+00:00
URL https://khronos.org/robots.txt
Redirect https://www.khronos.org/robots.txt
Redirect Domain www.khronos.org
Redirect Base khronos.org
Domain IPs 104.236.24.254
Redirect IPs 104.236.24.254
Response IP 104.236.24.254
Found Yes
Hash 6cf4137029a0bbe48774298df4b42316ad9eedafb668583c8c5cf260cc47c176
SimHash 549cf952e2a8

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /registrant/
Disallow /cms_registrations/
Disallow /webcl/wiki_webcl/
Disallow /members/login/
Disallow /api/
Disallow /webgl/wiki_1_15/
Disallow /webgl/wiki/Special%3ASearch
Disallow /webgl/wiki/Special%3ARandom

adsbot-google
amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot
claudebot/1.0
claude-web
cohere-ai
dataforseobot
facebookbot
friendlycrawler
google-extended
googleother
gptbot
img2dataset
imagesiftbot
magpie-crawler
meltwater
omgili
omgilibot
peer39_crawler
peer39_crawler/1.0
perplexitybot
piplbot
seekr
youbot
mediatoolkitbot
ahrefsbot
riddler
semrushbot-sa
ntentbot
mj12bot
mojeekbot
flamingo_searchengine
adsbot-google-mobile
adsbot-google-mobile-apps

Rule Path
Disallow /

Warnings

  • 1 invalid line.