shell.mu
robots.txt
Robots Exclusion Standard data for shell.mu
Resource Scan
Scan Details
Site Domain | shell.mu |
Base Domain | shell.mu |
Scan Status | Ok |
Last Scan | 2024-09-07T05:06:57+00:00 |
Next Scan | 2024-10-07T05:06:57+00:00 |
Last Scan
Scanned | 2024-09-07T05:06:57+00:00 |
URL | https://www.shell.mu/robots.txt |
Domain IPs | 2600:1413:b000:6::17d5:2bc6, 2600:1413:b000:6::17d5:2bd1, 96.17.96.17, 96.17.96.22 |
Response IP | 104.81.138.35 |
Found | Yes |
Hash | 4be46aef83128ab12da34d901b3a6e42759426cef2877782837f96b07bfa9adc |
SimHash | 810c8890e692 |
Groups
*
Rule | Path |
---|---|
Disallow | /external-redirects/home.html |
Disallow | /external-redirects/home/ |
Disallow | /external-redirects/promotion.html |
Disallow | /external-redirects/promotion/ |
Disallow | /motorists/motorsports/f1-fan-zone.html |
Disallow | /motorists/motorsports/f1-fan-zone/ |
Disallow | /motorists/motorsports/from-racetrack-to-roadside.html |
Disallow | /motorists/motorsports/from-racetrack-to-roadside/ |
Disallow | /motorists/motorsports/shell-and-scuderia-ferrari.html |
Disallow | /motorists/motorsports/shell-and-scuderia-ferrari/ |
Disallow | /motorists/motorsports/shell-role-in-the-race.html |
Disallow | /motorists/motorsports/shell-role-in-the-race/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.shell.mu/.sitemap.xml |