cairo-lang.org
robots.txt

Robots Exclusion Standard data for cairo-lang.org

Resource Scan

Scan Details

Site Domain cairo-lang.org
Base Domain cairo-lang.org
Scan Status Ok
Last Scan2026-02-05T23:28:23+00:00
Next Scan 2026-03-07T23:28:23+00:00

Last Scan

Scanned2026-02-05T23:28:23+00:00
URL https://cairo-lang.org/robots.txt
Domain IPs 104.26.10.34, 104.26.11.34, 172.67.74.131, 2606:4700:20::681a:a22, 2606:4700:20::681a:b22, 2606:4700:20::ac43:4a83
Response IP 172.67.74.131
Found Yes
Hash 7f7ba2ef6d051e2db69e6cc7c1d824a0b8de157331d49457e9a5c9f8c788ea56
SimHash 2948848286e6

Groups

*

Rule Path
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-login.php
Disallow /wp-content/plugins
Disallow /wp-content/cache
Disallow /wp-content/themes
Disallow /trackback
Disallow */trackback
Disallow */*/trackback
Disallow */*/feed/*/
Disallow */feed
Disallow /*?*
Disallow /cgi-bin
Disallow /*.php$
Disallow /*.inc$
Disallow /*.gz$
Disallow /playground/*
Allow */uploads
Allow /*.js
Allow /*.css
Allow /*.png
Allow /*.jpg
Allow /*.jpeg
Allow /*.gif
Allow /*.svg
Allow /*.webp
Allow /*.pdf

Other Records

Field Value
sitemap https://www.cairo-lang.org/sitemap_index.xml