krakow.gazeta.pl
robots.txt
Robots Exclusion Standard data for krakow.gazeta.pl
Resource Scan
Scan Details
Site Domain | krakow.gazeta.pl |
Base Domain | gazeta.pl |
Scan Status | Ok |
Last Scan | 2024-10-23T17:39:19+00:00 |
Next Scan | 2024-11-22T17:39:19+00:00 |
Last Scan
Scanned | 2024-10-23T17:39:19+00:00 |
URL | https://krakow.gazeta.pl/robots.txt |
Redirect | https://krakow.wyborcza.pl/robots.txt |
Redirect Domain | krakow.wyborcza.pl |
Redirect Base | wyborcza.pl |
Domain IPs | 80.252.0.135 |
Redirect IPs | 80.252.0.226 |
Response IP | 80.252.0.226 |
Found | Yes |
Hash | a438553195d3665391cfccfe387e2cd4d41cf867b9b8058b246bda6a8e0d5988 |
SimHash | 7a1f5b3b45b3 |
Groups
*
Rule | Path |
---|---|
Disallow | /ot-amp-consent |
Disallow | /*/wyszukaj/ |
Disallow | /*servlet |
Disallow | /reloadwww? |
Disallow | /dfptools/adview/ |
Disallow | /pub/ips/* |
Disallow | /ods? |
Disallow | /getFile.servlet* |
Disallow | /aliasy/blad.jsp |
Disallow | /znajdz.do |
Disallow | /portalSearch.do |
Disallow | /im/ab/b4/10/z17515435Q.jpg |
Disallow | /75224259/ |
Disallow | /opinions20/ |
Disallow | /duzyformat/1%2C130280%2C13165330%2CREGULAMIN_UDZIALU_W_KONKURSIE___JOLKA_W_DUZYM_FORMACIE__.html |
Disallow | /1%2C75478%2C17068768%2CCBA_zatrzymalo_wysokich_urzednikow_ZUS__Chodzi_o_przetargi.html |
Disallow | /bialystok/1%2C35241%2C19674535* |
Disallow | /bialystok/1%2C35241%2C19697480* |
Disallow | /paypath/ |
Disallow | /lpages/ |
Disallow | /pages/tweaks/stattrack_article.html |
googlebot-news
Rule | Path |
---|---|
Disallow | /nowy/ |
Disallow | /mapa_strony |
Disallow | /*/wyszukaj/ |
Disallow | /*/51%2C |
Disallow | /*/55%2C |
Disallow | /*/2%2C |
Disallow | /*order%3D |
Disallow | /*obxx%3D |
Disallow | /*tag%3D |
Disallow | /reloadwww? |
Disallow | /ods? |
Disallow | /*servlet |
Disallow | /dfptools/adview/ |
Disallow | /opinions20/ |
mozilla/5.0 (macintosh; intel mac os x 10_10_1) applewebkit/600.2.5 (khtml, like gecko) version/8.0.2 safari/600.2.5 (amazonbot/0.1; +https://developer.amazon.com/support/amazonbot),"156,975"
Rule | Path |
---|---|
Disallow | / |
sirdatabot (+https://semantic-api.docs.sirdata.net/contextual-api/contextual-api/introduction),"81,530"
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; paqlebot/2.0; +http://www.paqle.dk/about/paqlebot),"28,241"
Rule | Path |
---|---|
Disallow | / |
mozilla/5.0 (compatible; semanticbot/1.0; +http://sempi.tech/bot.html),"14,317"
Rule | Path |
---|---|
Disallow | / |
Warnings
- 4 invalid lines.
Comments