linde-gas.ee
robots.txt

Robots Exclusion Standard data for linde-gas.ee

Resource Scan

Scan Details

Site Domain linde-gas.ee
Base Domain linde-gas.ee
Scan Status Ok
Last Scan2024-10-05T16:30:42+00:00
Next Scan 2024-10-19T16:30:42+00:00

Last Scan

Scanned2024-10-05T16:30:42+00:00
URL https://linde-gas.ee/robots.txt
Redirect http://www.linde-gas.ee/et/robots.txt
Redirect Domain www.linde-gas.ee
Redirect Base linde-gas.ee
Domain IPs 23.215.7.21, 23.215.7.29, 2600:1413:1::1734:ab3b, 2600:1413:1::1734:abcb
Redirect IPs 23.215.7.21, 23.215.7.4
Response IP 23.32.29.104
Found Yes
Hash 6f531b1caaaec73e9aae0c06d58f2f1473aa7394ce82c1508503fd88bcee54c4
SimHash a90f5d53ad7c

Groups

*

Rule Path
Disallow *search.html
Disallow *error.html
Disallow *error-404.html
Disallow *se_blank.html
Disallow *tracking.gif
Disallow *html2pdf
Disallow *xml4flow
Disallow */system/*
Disallow */dynamic/*
Disallow */cforms/*
Disallow /?Open
Disallow *nav.html
Disallow */lf/*
Disallow */LegalHome*
Disallow */LegalStatements*
Disallow */Logoff*
Disallow */LogonForm*
Disallow */LINGuestCheckoutFormView*
Disallow */SearchDisplay*
Disallow */search/*
Disallow */ProductDisplay*
Disallow /*/campaign-*
Disallow */HelpSupportView*
Disallow */webapp/wcs/stores/servlet/*
Disallow */shop/webapp/wcs/stores/*G

Other Records

Field Value
sitemap http://www.linde-gas.ee/en/sitemap.xml
sitemap http://www.linde-gas.ee/et/sitemap.xml
sitemap http://www.linde-gas.ee/ru/sitemap.xml

Comments

  • adding below snippet as part of IM-18-018260
  • adding below snippet as part of IM-18-066698