polsatgo.pl
robots.txt
Robots Exclusion Standard data for polsatgo.pl
Resource Scan
Scan Details
Site Domain | polsatgo.pl |
Base Domain | polsatgo.pl |
Scan Status | Ok |
Last Scan | 2024-05-28T14:15:59+00:00 |
Next Scan | 2024-06-04T14:15:59+00:00 |
Last Scan
Scanned | 2024-05-28T14:15:59+00:00 |
URL | https://polsatgo.pl/robots.txt |
Domain IPs | 37.247.239.170, 37.247.239.171, 37.247.239.172, 37.247.239.173 |
Response IP | 37.247.239.171 |
Found | Yes |
Hash | f26cccf07d2217648bff66d4dd5a9e873b692a5212a350705240137ebb0c4c36 |
SimHash | 429912e0d39c |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 86400 |
googlebot
googlebot-video
applebot
bingbot
yandex
yandexbot
yandexmobilebot
yandexvideo
yandexwebmaster
yandexsitelinks
Rule | Path |
---|---|
Allow | / |
adsbot-google
twitterbot
adidxbot
Rule | Path |
---|---|
Allow | / |
Disallow | /uzytkownik |
Disallow | /panel/moje-konto |
Disallow | /panel/moje-platnosci |
Disallow | /panel/zgody |
Disallow | /moja-lista |
*
Rule | Path |
---|---|
Disallow | / |