shell.com.bn
robots.txt

Robots Exclusion Standard data for shell.com.bn

Resource Scan

Scan Details

Site Domain shell.com.bn
Base Domain shell.com.bn
Scan Status Ok
Last Scan2024-05-22T10:18:31+00:00
Next Scan 2024-06-21T10:18:31+00:00

Last Scan

Scanned2024-05-22T10:18:31+00:00
URL https://shell.com.bn/robots.txt
Redirect https://www.shell.com.bn/robots.txt
Redirect Domain www.shell.com.bn
Redirect Base shell.com.bn
Domain IPs 4.210.156.184
Redirect IPs 125.56.219.3, 23.32.29.99, 2600:1413:b000:6::17d5:2bcf
Response IP 104.88.70.128
Found Yes
Hash f948fc0697580876396635777533899cc228a093f6fbae9ecfcb229fc03f5c57
SimHash 0b108a40cf33

Groups

siteimprovebot

Rule Path
Allow /

siteimprovebot-crawler

Rule Path
Allow /

*

Rule Path
Disallow

Other Records

Field Value
sitemap https://www.shell.com.bn/.sitemap.xml