shell.com.pr
robots.txt

Robots Exclusion Standard data for shell.com.pr

Resource Scan

Scan Details

Site Domain shell.com.pr
Base Domain shell.com.pr
Scan Status Ok
Last Scan2024-09-20T00:57:27+00:00
Next Scan 2024-10-20T00:57:27+00:00

Last Scan

Scanned2024-09-20T00:57:27+00:00
URL https://shell.com.pr/robots.txt
Redirect https://www.shell.com.pr/robots.txt
Redirect Domain www.shell.com.pr
Redirect Base shell.com.pr
Domain IPs 4.210.156.184
Redirect IPs 2600:1413:b000:6::17d5:2bce, 2600:1413:b000:6::17d5:2bcf, 96.17.96.27, 96.17.96.28
Response IP 23.59.168.136
Found Yes
Hash ca97681f5beff098d2e2c651c7128d4a1609504a466bcad46cb8d32e364f4716
SimHash cb4047184595

Groups

siteimprovebot

Rule Path
Allow /

siteimprovebot-crawler

Rule Path
Allow /

*

Rule Path
Disallow /en_pr/error-page.html
Disallow /en_pr/error-page/
Disallow /en_pr/external-redirects.html
Disallow /en_pr/external-redirects/
Disallow /es_pr/links.html
Disallow /es_pr/links/

Other Records

Field Value
sitemap https://www.shell.com.pr/.sitemap.xml
sitemap https://www.shell.com.pr/en_pr.sitemap.xml