sagemath.org
robots.txt
Robots Exclusion Standard data for sagemath.org
Resource Scan
Scan Details
Site Domain | sagemath.org |
Base Domain | sagemath.org |
Scan Status | Ok |
Last Scan | 2025-08-27T00:05:47+00:00 |
Next Scan | 2025-09-26T00:05:47+00:00 |
Last Scan
Scanned | 2025-08-27T00:05:47+00:00 |
URL | https://sagemath.org/robots.txt |
Redirect | https://www.sagemath.org/robots.txt |
Redirect Domain | www.sagemath.org |
Redirect Base | sagemath.org |
Domain IPs | 104.26.10.200, 104.26.11.200, 172.67.75.32, 2606:4700:20::681a:ac8, 2606:4700:20::681a:bc8, 2606:4700:20::ac43:4b20 |
Redirect IPs | 104.26.10.200, 104.26.11.200, 172.67.75.32, 2606:4700:20::681a:ac8, 2606:4700:20::681a:bc8, 2606:4700:20::ac43:4b20 |
Response IP | 172.67.75.32 |
Found | Yes |
Hash | 8cbeac8ebfce5ce89d4cb9de92ad872336a37ee669a71fb1d5ba0a47c8bd7f4f |
SimHash | 29315e49fd43 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /tmp/ |
Disallow | /inc/ |
Disallow | /sandbox/ |
Disallow | /SAGEbin/ |
Disallow | /old/ |
Disallow | /mirror/ |
Disallow | /bin/ |
Disallow | /src/ |
Disallow | /spkg/ |
Disallow | /packages/ |
Disallow | /documentation/ |
Disallow | /git-developer-guide/ |