pypi.python.org
robots.txt
Robots Exclusion Standard data for pypi.python.org
Resource Scan
Scan Details
| Site Domain | pypi.python.org |
| Base Domain | python.org |
| Scan Status | Ok |
| Last Scan | 2025-11-20T19:38:04+00:00 |
| Next Scan | 2025-12-20T19:38:04+00:00 |
Last Scan
| Scanned | 2025-11-20T19:38:04+00:00 |
| URL | https://pypi.python.org/robots.txt |
| Redirect | https://pypi.org/robots.txt |
| Redirect Domain | pypi.org |
| Redirect Base | pypi.org |
| Domain IPs | 151.101.0.223, 151.101.128.223, 151.101.192.223, 151.101.64.223, 2a04:4e42:200::223, 2a04:4e42:400::223, 2a04:4e42:600::223, 2a04:4e42::223 |
| Redirect IPs | 151.101.0.223, 151.101.128.223, 151.101.192.223, 151.101.64.223, 2a04:4e42:200::223, 2a04:4e42:400::223, 2a04:4e42:600::223, 2a04:4e42::223 |
| Response IP | 151.101.192.223 |
| Found | Yes |
| Hash | 5371472bf7e4bd347b0d699b6316810c5fa9c8ed464e3b8fc0a023e4b497aac8 |
| SimHash | e99569c4e851 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /simple/ |
| Disallow | /packages/ |
| Disallow | /_includes/authed/ |
| Disallow | /pypi/*/json |
| Disallow | /pypi/*/*/json |
| Disallow | /pypi*? |
| Disallow | /search* |
| Disallow | /_/ |
| Disallow | /integrity/ |
| Disallow | /account/ |
| Disallow | /admin/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://pypi.org/sitemap.xml |