registry.khronos.org
robots.txt

Robots Exclusion Standard data for registry.khronos.org

Resource Scan

Scan Details

Site Domain registry.khronos.org
Base Domain khronos.org
Scan Status Ok
Last Scan2024-11-03T08:25:51+00:00
Next Scan 2024-12-03T08:25:51+00:00

Last Scan

Scanned2024-11-03T08:25:51+00:00
URL https://registry.khronos.org/robots.txt
Domain IPs 174.138.88.143, 2604:a880:800:10::985:a001
Response IP 174.138.88.143
Found Yes
Hash ca08a0f2244198c64aba17ce7e4f2afb40699a068a2ba4d7887ae3886fdea776
SimHash 708cd972b680

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /vulkan/specs/1.0-extensions
Disallow /vulkan/specs/1.2-extensions
Disallow /vulkan/specs/1.2-khr-extensions
Disallow /vulkan/specs/1.1
Disallow /vulkan/specs/1.2
Disallow /vulkan/specs/1.0
Disallow /vulkan/specs/1.1-khr-extensions
Disallow /vulkan/specs/1.1-extensions
Disallow /vulkan/specs/1.0-wsi_extensions
Disallow /OpenCL/sdk/1.0
Disallow /OpenCL/sdk/1.1
Disallow /OpenCL/sdk/1.2
Disallow /OpenCL/sdk/2.0
Disallow /OpenCL/sdk/2.1
Disallow /OpenCL/sdk/2.2
Disallow /OpenCL/specs/2.2
Disallow /OpenCL/specs/opencl-2.1.pdf
Disallow /OpenCL/specs/opencl-2.0.pdf
Disallow /OpenCL/specs/opencl-1.2.pdf
Disallow /OpenCL/specs/opencl-1.1.pdf
Disallow /OpenCL/specs/opencl-1.0.pdf
Disallow /OpenXR/specs/1.0/html/xrspec.html
Disallow /OpenXR/specs/1.0/pdf/xrspec.pdf

adsbot-google
amazonbot
anthropic-ai
applebot
awariorssbot
awariosmartbot
bytespider
ccbot
chatgpt-user
claudebot/1.0
claudebot
claude-web
cohere-ai
dataforseobot
facebookbot
friendlycrawler
google-extended
googleother
gptbot
img2dataset
imagesiftbot
magpie-crawler
meltwater
omgili
omgilibot
petalbot
peer39_crawler
peer39_crawler/1.0
perplexitybot
piplbot
seekr
youbot
yisouspider
mediatoolkitbot
ahrefsbot
riddler
semrushbot-sa
semrushbot/7~bl
ntentbot
mj12bot
mojeekbot
flamingo_searchengine
adsbot-google-mobile
adsbot-google-mobile-apps

Rule Path
Disallow /

Other Records

Field Value
sitemap https://registry.khronos.org/sitemap_index.xml

Warnings

  • 1 invalid line.