wiki.python.org
robots.txt

Robots Exclusion Standard data for wiki.python.org

Resource Scan

Scan Details

Site Domain wiki.python.org
Base Domain python.org
Scan Status Ok
Last Scan2025-12-01T13:45:55+00:00
Next Scan 2025-12-31T13:45:55+00:00

Last Scan

Scanned2025-12-01T13:45:55+00:00
URL https://wiki.python.org/robots.txt
Domain IPs 159.89.245.108, 167.99.21.118, 2604:a880:800:10::92a:1001, 2604:a880:800:10::f7d:7001
Response IP 167.99.21.118
Found Yes
Hash 5fe81fdf3d4865da5b68dc4d0a1bd2739843cccb9afc925609a9e6f282a5cd9a
SimHash 6548d5d54135

Groups

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

slurp

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20