businessinsider.com.pl
robots.txt
Robots Exclusion Standard data for businessinsider.com.pl
Resource Scan
Scan Details
| Site Domain | businessinsider.com.pl |
| Base Domain | businessinsider.com.pl |
| Scan Status | Ok |
| Last Scan | 2024-06-21T03:11:16+00:00 |
| Next Scan | 2024-06-28T03:11:16+00:00 |
Last Scan
| Scanned | 2024-06-21T03:11:16+00:00 |
| URL | https://businessinsider.com.pl/robots.txt |
| Domain IPs | 13.227.254.109, 13.227.254.119, 13.227.254.122, 13.227.254.49 |
| Response IP | 13.227.254.119 |
| Found | Yes |
| Hash | 318962ca0b87d1e8224fd70d685acde53e86206a17351ee911d3dcdaecbecb7f |
| SimHash | 4844d604ab51 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /szukaj/* |
| Disallow | /gielda/komunikat* |
| Disallow | /*?*sort= |
| Disallow | /*%26*sort%3D |
| Disallow | /user-session-proxy/* |
| Disallow | /paywall* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://businessinsider.com.pl/sitemap-news.xml |
| sitemap | https://businessinsider.com.pl/sitemap-video.xml |