gs24.pl
robots.txt
Robots Exclusion Standard data for gs24.pl
Resource Scan
Scan Details
Site Domain | gs24.pl |
Base Domain | gs24.pl |
Scan Status | Ok |
Last Scan | 2024-06-23T03:01:59+00:00 |
Next Scan | 2024-06-30T03:01:59+00:00 |
Last Scan
Scanned | 2024-06-23T03:01:59+00:00 |
URL | https://gs24.pl/robots.txt |
Domain IPs | 104.18.24.205, 104.18.25.205, 2606:4700::6812:18cd, 2606:4700::6812:19cd |
Response IP | 104.18.24.205 |
Found | Yes |
Hash | 31dfb30f3a9f9399aa4068f923577fadac4176541e31983e43023b1548cc94a1 |
SimHash | 4904405a08d1 |
Groups
*
Rule | Path |
---|---|
Disallow | /*?ses |
Disallow | /_ |
Disallow | /ajax/* |
Disallow | /onclick/* |
Disallow | /.well-known/amphtml/apikey.pub |
Disallow | /*link_label* |
Other Records
Field | Value |
---|---|
sitemap | https://gs24.pl/sitemapa/ |
sitemap | https://gs24.pl/google_news/ |