metrocafe.pl
robots.txt
Robots Exclusion Standard data for metrocafe.pl
Resource Scan
Scan Details
Site Domain | metrocafe.pl |
Base Domain | metrocafe.pl |
Scan Status | Ok |
Last Scan | 2024-09-17T20:32:17+00:00 |
Next Scan | 2024-09-24T20:32:17+00:00 |
Last Scan
Scanned | 2024-09-17T20:32:17+00:00 |
URL | http://metrocafe.pl/robots.txt |
Redirect | http://metro.gazeta.pl/robots.txt |
Redirect Domain | metro.gazeta.pl |
Redirect Base | gazeta.pl |
Domain IPs | 80.252.0.132 |
Redirect IPs | 80.252.0.132 |
Response IP | 80.252.0.132 |
Found | Yes |
Hash | 4d23aa313dd0f692f60790baae70262004bffb9879acfe77e65eedec998701bf |
SimHash | 739f532b47a3 |
Groups
*
Rule | Path |
---|---|
Disallow | /ot-amp-consent |
Disallow | /*/wyszukaj/ |
Disallow | /*servlet |
Disallow | /reloadwww? |
Disallow | /dfptools/adview/ |
Disallow | /pub/ips/* |
Disallow | /ods? |
Disallow | /getFile.servlet* |
Disallow | /aliasy/blad.jsp |
Disallow | /znajdz.do |
Disallow | /portalSearch.do |
Disallow | /im/ab/b4/10/z17515435Q.jpg |
Disallow | /75224259/ |
Warnings
- 4 invalid lines.
Comments