docs.pytorch.org
robots.txt
Robots Exclusion Standard data for docs.pytorch.org
Resource Scan
Scan Details
Site Domain | docs.pytorch.org |
Base Domain | pytorch.org |
Scan Status | Ok |
Last Scan | 2025-07-17T01:27:56+00:00 |
Next Scan | 2025-08-16T01:27:56+00:00 |
Last Scan
Scanned | 2025-07-17T01:27:56+00:00 |
URL | https://docs.pytorch.org/robots.txt |
Domain IPs | 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153, 2606:50c0:8000::153, 2606:50c0:8001::153, 2606:50c0:8002::153, 2606:50c0:8003::153 |
Response IP | 185.199.108.153 |
Found | Yes |
Hash | 4a0f0ee0b9dbc3c0f7c75db0ddc4fcaafe36ff3b6011f48342f96d2ee7083caf |
SimHash | 44024218e316 |
Groups
*
Rule | Path |
---|---|
Disallow | /docs/0.1.12/ |
Disallow | /docs/0.2.0/ |
Disallow | /docs/0.3.* |
Disallow | /docs/0.4.* |
Disallow | /docs/1.0.* |
Disallow | /docs/1.1.0/ |
Disallow | /docs/1.2.0/ |
Disallow | /docs/1.3.* |
Disallow | /docs/1.4.0/ |
Disallow | /docs/1.5.* |
Disallow | /docs/1.6.0/ |
Disallow | /docs/1.7.* |
Disallow | /docs/1.8.* |
Disallow | /docs/1.9.* |
Disallow | /docs/master/ |
Disallow | /torchx/*/ |
Allow | /torchx/latest/ |
Allow | /torchx/main/ |
Disallow | /elastic/*/ |
Allow | /elastic/latest/ |
Comments