ffmpeg.org
robots.txt
Robots Exclusion Standard data for ffmpeg.org
Resource Scan
Scan Details
| Site Domain | ffmpeg.org |
| Base Domain | ffmpeg.org |
| Scan Status | Ok |
| Last Scan | 2024-10-29T16:56:21+00:00 |
| Next Scan | 2024-11-28T16:56:21+00:00 |
Last Scan
| Scanned | 2024-10-29T16:56:21+00:00 |
| URL | https://ffmpeg.org/robots.txt |
| Domain IPs | 79.124.17.100 |
| Response IP | 79.124.17.100 |
| Found | Yes |
| Hash | 169d17e07387b90b2d5ddb8143ae5b9df7db45ce4dbedcc818cbf2ae9776fdc2 |
| SimHash | 79db9cd06b70 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /gitweb/ |
| Disallow | /*a%3Dsearch* |
| Disallow | /*/search/* |
| Disallow | /*a%3Dblobdiff* |
| Disallow | /*/blobdiff/* |
| Disallow | /*a%3Dcommitdiff* |
| Disallow | /*/commitdiff/* |
| Disallow | /*a%3Dsnapshot* |
| Disallow | /*/snapshot/* |
| Disallow | /*a%3Dblame* |
| Disallow | /*/blame/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Comments