linde-gas.is
robots.txt

Robots Exclusion Standard data for linde-gas.is

Resource Scan

Scan Details

Site Domain linde-gas.is
Base Domain linde-gas.is
Scan Status Ok
Last Scan2024-11-05T02:20:28+00:00
Next Scan 2024-11-19T02:20:28+00:00

Last Scan

Scanned2024-11-05T02:20:28+00:00
URL https://linde-gas.is/robots.txt
Redirect https://www.linde-gas.is/is/robots.txt
Redirect Domain www.linde-gas.is
Redirect Base linde-gas.is
Domain IPs 23.215.7.21, 23.215.7.29, 2600:1413:b000:1b::17d7:715, 2600:1413:b000:1b::17d7:71d
Redirect IPs 23.32.29.16, 96.17.180.43
Response IP 23.32.29.16
Found Yes
Hash b297db694cc2a38a87c2b4c583ff33ec7aca42e20c0b6e07e265626e2a1530da
SimHash b90d5d4bad7f

Groups

*

Rule Path
Disallow *search.html
Disallow *error.html
Disallow *error-404.html
Disallow *se_blank.html
Disallow *tracking.gif
Disallow *html2pdf
Disallow *xml4flow
Disallow */system/*
Disallow */dynamic/*
Disallow */cforms/*
Disallow /?Open
Disallow *nav.html
Disallow */LegalHome*
Disallow */LegalStatements*
Disallow */Logoff*
Disallow */LogonForm*
Disallow */LINGuestCheckoutFormView*
Disallow */SearchDisplay*
Disallow */search/*
Disallow */ProductDisplay*
Disallow /*/campaign-*
Disallow */HelpSupportView*
Disallow */webapp/wcs/stores/servlet/*
Disallow */shop/webapp/wcs/stores/*G

Other Records

Field Value
sitemap https://www.linde-gas.is/en/sitemap.xml
sitemap https://www.linde-gas.is/is/sitemap.xml

Comments

  • adding below snippet as part of IM-18-018260
  • adding below snippet as part of IM-18-066698