shell.cl
robots.txt

Robots Exclusion Standard data for shell.cl

Resource Scan

Scan Details

Site Domain shell.cl
Base Domain shell.cl
Scan Status Ok
Last Scan2024-10-05T06:11:55+00:00
Next Scan 2024-11-04T06:11:55+00:00

Last Scan

Scanned2024-10-05T06:11:55+00:00
URL https://shell.cl/robots.txt
Redirect https://www.shell.cl/robots.txt
Redirect Domain www.shell.cl
Redirect Base shell.cl
Domain IPs 4.210.156.184
Redirect IPs 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bcf, 96.17.96.27, 96.17.96.28
Response IP 104.88.70.128
Found Yes
Hash ca0fb71999bdc7b3224144bf6e1850e6707dac59c16ff2bba858a52beea6fc91
SimHash 0a0409008833

Groups

siteimprovebot

Rule Path
Allow /

siteimprovebot-crawler

Rule Path
Allow /

*

Rule Path
Disallow /error.html
Disallow /error/
Disallow /external-redirects.html
Disallow /external-redirects/
Disallow /tag-search.html
Disallow /tag-search/

Other Records

Field Value
sitemap https://www.shell.cl/.sitemap.xml