shell.sk
robots.txt
Robots Exclusion Standard data for shell.sk
Resource Scan
Scan Details
Site Domain | shell.sk |
Base Domain | shell.sk |
Scan Status | Ok |
Last Scan | 2024-09-22T02:23:30+00:00 |
Next Scan | 2024-10-22T02:23:30+00:00 |
Last Scan
Scanned | 2024-09-22T02:23:30+00:00 |
URL | https://shell.sk/robots.txt |
Redirect | https://www.shell.sk/robots.txt |
Redirect Domain | www.shell.sk |
Redirect Base | shell.sk |
Domain IPs | 4.210.156.184 |
Redirect IPs | 23.59.168.136, 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bcf |
Response IP | 23.59.168.136 |
Found | Yes |
Hash | 55de8c8bf9f012f7a6321368ead0678f7d4b1d2fdb9441b131f74657e1f42389 |
SimHash | 0a044f782c32 |
Groups
*
Rule | Path |
---|---|
Disallow | /cerpacie-stanice-shell/akcie.html |
Disallow | /cerpacie-stanice-shell/akcie/ |
Disallow | /error.html |
Disallow | /error/ |
Disallow | /external-redirects.html |
Disallow | /external-redirects/ |
Disallow | /firemni-zakaznici/cestna-nakladna-doprava.html |
Disallow | /firemni-zakaznici/cestna-nakladna-doprava/ |
Disallow | /firemni-zakaznici/shell-fleet-solutions-vozidla-do-12-ton/direction-zero-emission-test-iframe.html |
Disallow | /firemni-zakaznici/shell-fleet-solutions-vozidla-do-12-ton/direction-zero-emission-test-iframe/ |
Disallow | /tag-search.html |
Disallow | /tag-search/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.shell.sk/.sitemap.xml |