podroze.onet.pl
robots.txt
Robots Exclusion Standard data for podroze.onet.pl
Resource Scan
Scan Details
Site Domain | podroze.onet.pl |
Base Domain | onet.pl |
Scan Status | Ok |
Last Scan | 2024-04-23T23:00:52+00:00 |
Next Scan | 2024-05-23T23:00:52+00:00 |
Last Scan
Scanned | 2024-04-23T23:00:52+00:00 |
URL | https://podroze.onet.pl/robots.txt |
Domain IPs | 54.192.18.107, 54.192.18.43, 54.192.18.5, 54.192.18.63 |
Response IP | 13.33.88.95 |
Found | Yes |
Hash | af9333a4ffa46616df6c9ddaae0c1f58ec67ce7b8e27b60713802aabb45da864 |
SimHash | 4250450409d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /szukaj/* |
Disallow | /*zglos-naruszenie.html |
Disallow | /*odpowiedz.html |
Disallow | /*komentuj.html |
Disallow | /*fb_comment_id%3D* |
Disallow | /*dodaj-watek.html |
Disallow | /*watek-odpowiedz.html |
Disallow | /*odpowiedz-cytuj.html |
Disallow | /*td-naruszenie-zasad.html |
Disallow | /paywall/* |
Disallow | *?ress=mobile&ajax=* |
Disallow | /widget-liveblog-story-results.html* |
Disallow | /user-session-proxy/* |