przegladsportowy.onet.pl
robots.txt

Robots Exclusion Standard data for przegladsportowy.onet.pl

Resource Scan

Scan Details

Site Domain przegladsportowy.onet.pl
Base Domain onet.pl
Scan Status Ok
Last Scan2024-11-09T09:06:31+00:00
Next Scan 2024-11-16T09:06:31+00:00

Last Scan

Scanned2024-11-09T09:06:31+00:00
URL https://przegladsportowy.onet.pl/robots.txt
Domain IPs 108.157.254.119, 108.157.254.49, 108.157.254.5, 108.157.254.58
Response IP 108.157.254.119
Found Yes
Hash f98472a5cefce51e02ded32886b374c02bc7967e6c6f8075a48e9a689104058e
SimHash 6141ea5a48d5

Groups

*

Rule Path
Disallow /*.pdf$
Disallow /*.wmv$
Disallow /*.flv$
Disallow /*.mpg$
Disallow /*.avi$
Disallow /*.inl$
Disallow /*.doc$
Disallow /*.xls$
Disallow /Drukuj/
Disallow /fb_comment_id%3D
Disallow /paywall/*
Disallow /user-session-proxy/*
Disallow /njYjD8BNiL/*
Disallow /__acc/
Disallow /_cdf/
Disallow /_variant/
Disallow /a8f4d8cd95e164917035b64b867a45dd