za.pycon.org
robots.txt

Robots Exclusion Standard data for za.pycon.org

Resource Scan

Scan Details

Site Domain za.pycon.org
Base Domain pycon.org
Scan Status Ok
Last Scan2025-12-10T19:38:55+00:00
Next Scan 2026-01-09T19:38:55+00:00

Last Scan

Scanned2025-12-10T19:38:55+00:00
URL https://za.pycon.org/robots.txt
Domain IPs 139.162.253.21, 2a01:7e00:e000:810::1
Response IP 139.162.253.21
Found Yes
Hash 935cf004b9d82ce9127eba9256f368c4b1dde62ba417d3d10ae3b7a6a7ee6d05
SimHash 3a5fdb80e0a0

Groups

msnbot
bingbot/2.0
bingbot
ocelli
twiceler
audisto-essential
aspiegelbot
petalbot
claudebot
yandex

Rule Path
Disallow /wiki/*action%3D
Disallow */annotate/
Disallow */raw-annotate/
Disallow /trac/*/log/
Disallow /trac/*/browser/
Disallow /trac/*/changeset/

Other Records

Field Value
crawl-delay 600

msnbot-products

Rule Path
Disallow /

googlebot
duckduckbot
slurp

Rule Path
Disallow /wiki/*action%3D
Disallow */annotate/
Disallow */raw-annotate/
Disallow /trac/*/log/
Disallow /trac/*/changeset/
Disallow /trac/*/browser/

mediapartners-google
adsbot-google

Rule Path
Disallow /

ahrefsbot
mj12bot
purebot
twengabot-discover
twengabot
dotbot
sogou spider
sitebot
semrushbot
semrushbot-sa
mauibot
adsbot/3.1
adsbot
blexbot
seekportbot

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

oai-searchbot

Rule Path
Disallow /

Warnings

  • 1 invalid line.