freedisc.pl
robots.txt

Robots Exclusion Standard data for freedisc.pl

Resource Scan

Scan Details

Site Domain freedisc.pl
Base Domain freedisc.pl
Scan Status Ok
Last Scan2024-05-14T04:38:49+00:00
Next Scan 2024-05-21T04:38:49+00:00

Last Scan

Scanned2024-05-14T04:38:49+00:00
URL https://freedisc.pl/robots.txt
Domain IPs 185.16.37.203, 185.16.37.204, 185.16.37.205, 185.16.37.206, 185.16.37.51, 185.16.37.52, 185.16.37.53, 185.16.37.54
Response IP 185.16.37.206
Found Yes
Hash 9a4785b0bf3cff4204f46ab672d7e1f6a86d096b7d8fb8e3350b6f1af60bbf9d
SimHash a00fde2ac97a

Groups

*

Rule Path
Allow /
Disallow /uploads/
Disallow /download/
Disallow /adserver/campaign/*
Disallow /search%2C*
Disallow /search/*
Disallow /pdf/*
Disallow /photo-remote.png
Disallow /video/
Disallow /video/*
Disallow /video_dummy/
Disallow /video_dummy/*

ia_archiver

Rule Path
Disallow /