freedisc.pl
robots.txt
Robots Exclusion Standard data for freedisc.pl
Resource Scan
Scan Details
Site Domain | freedisc.pl |
Base Domain | freedisc.pl |
Scan Status | Ok |
Last Scan | 2024-05-14T04:38:49+00:00 |
Next Scan | 2024-05-21T04:38:49+00:00 |
Last Scan
Scanned | 2024-05-14T04:38:49+00:00 |
URL | https://freedisc.pl/robots.txt |
Domain IPs | 185.16.37.203, 185.16.37.204, 185.16.37.205, 185.16.37.206, 185.16.37.51, 185.16.37.52, 185.16.37.53, 185.16.37.54 |
Response IP | 185.16.37.206 |
Found | Yes |
Hash | 9a4785b0bf3cff4204f46ab672d7e1f6a86d096b7d8fb8e3350b6f1af60bbf9d |
SimHash | a00fde2ac97a |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /uploads/ |
Disallow | /download/ |
Disallow | /adserver/campaign/* |
Disallow | /search%2C* |
Disallow | /search/* |
Disallow | /pdf/* |
Disallow | /photo-remote.png |
Disallow | /video/ |
Disallow | /video/* |
Disallow | /video_dummy/ |
Disallow | /video_dummy/* |