video.cookist.it
robots.txt
Robots Exclusion Standard data for video.cookist.it
Resource Scan
Scan Details
Site Domain | video.cookist.it |
Base Domain | cookist.it |
Scan Status | Ok |
Last Scan | 2024-05-18T20:53:05+00:00 |
Next Scan | 2024-06-17T20:53:05+00:00 |
Last Scan
Scanned | 2024-05-18T20:53:05+00:00 |
URL | https://video.cookist.it/robots.txt |
Domain IPs | 52.18.94.249, 54.220.42.175, 54.246.155.116 |
Response IP | 54.246.155.116 |
Found | Yes |
Hash | 8c5b05f9620a5c4a60755700fb383610a1c751a96e34e93a8f83c2f366baa8f4 |
SimHash | 0d06670087d3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /static/ |
Disallow | /manage/ |
Disallow | /admin/ |
Disallow | /contribute |
Disallow | /video/*/download |
Disallow | /ogvideo/ |
Disallow | /more |
Disallow | /1010633/ |
Disallow | /xhr/ |
Disallow | /preview/ |
Disallow | /plugins/ |
Disallow | /search |
Disallow | /previewembed/ |
Other Records
Field | Value |
---|---|
sitemap | https://video.cookist.it/sitemap.xml |
sitemap | https://video.cookist.it/sitemap-video.xml |
sitemap | https://video.cookist.it/sitemap-images.xml |