schar.com
robots.txt

Robots Exclusion Standard data for schar.com

Resource Scan

Scan Details

Site Domain schar.com
Base Domain schar.com
Scan Status Ok
Last Scan2024-09-23T11:27:01+00:00
Next Scan 2024-10-23T11:27:01+00:00

Last Scan

Scanned2024-09-23T11:27:01+00:00
URL http://schar.com/robots.txt
Redirect https://www.schaer.com/robots.txt
Redirect Domain www.schaer.com
Redirect Base schaer.com
Domain IPs 52.59.148.170
Redirect IPs 151.101.130.217, 151.101.194.217, 151.101.2.217, 151.101.66.217, 2a04:4e42:200::729, 2a04:4e42:400::729, 2a04:4e42:600::729, 2a04:4e42::729
Response IP 199.232.46.217
Found Yes
Hash 4dd142e49e9649c92332b9d892f2396d614b03f5638caa32da051e44165f71ab
SimHash 2d94bd0bc76c

Groups

*

Rule Path
Allow /core/*.css$
Allow /core/*.css?
Allow /core/*.js$
Allow /core/*.js?
Allow /core/*.gif
Allow /core/*.jpg
Allow /core/*.jpeg
Allow /core/*.png
Allow /core/*.svg
Allow /profiles/*.css$
Allow /profiles/*.css?
Allow /profiles/*.js$
Allow /profiles/*.js?
Allow /profiles/*.gif
Allow /profiles/*.jpg
Allow /profiles/*.jpeg
Allow /profiles/*.png
Allow /profiles/*.svg
Disallow /core/
Disallow /profiles/
Disallow /README.md
Disallow /composer/Metapackage/README.txt
Disallow /composer/Plugin/ProjectMessage/README.md
Disallow /composer/Plugin/Scaffold/README.md
Disallow /composer/Plugin/VendorHardening/README.txt
Disallow /composer/Template/README.txt
Disallow /modules/README.txt
Disallow /sites/README.txt
Disallow /themes/README.txt
Disallow /web.config
Disallow /admin/
Disallow /comment/reply/
Disallow /filter/tips
Disallow /node/add/
Disallow /search/
Disallow /user/register
Disallow /user/password
Disallow /user/login
Disallow /user/logout
Disallow /media/oembed
Disallow /*/media/oembed
Disallow /index.php/admin/
Disallow /index.php/comment/reply/
Disallow /index.php/filter/tips
Disallow /index.php/node/add/
Disallow /index.php/search/
Disallow /index.php/user/password
Disallow /index.php/user/register
Disallow /index.php/user/login
Disallow /index.php/user/logout
Disallow /index.php/media/oembed
Disallow /index.php/*/media/oembed

bingbot

Rule Path
Disallow */search?
Disallow /*/search/
Disallow /*/search?*
Disallow /*/search/*
Disallow */search/
Disallow */search?*
Disallow */search/*
Disallow *?page=*
Disallow */products-search
Disallow */produktsoegning
Disallow */ricerca-prodotti
Disallow */recherche-de-produits
Disallow */buscador-de-productos
Disallow */producten-zoeken
Disallow */produktsokning
Disallow */produktsok
Disallow */tuotehaku
Disallow */wyszukiwanie-produktow
Disallow */hledani-produktu
Disallow */vyhladanie-vyrobkov
Disallow */tuotehaku
Disallow */poisk-tovarov
Disallow */onde-encontrar
Disallow */pesquisa-de-produtos
Disallow */urunleri-ara
Disallow */cautare-produse
Disallow */anazitisi-proionton
Disallow */admin/*
Disallow */comment/reply/*
Disallow */filter/tips
Disallow */node/add/*
Disallow */user/password
Disallow */user/logout
Disallow */node/*/ajax-comments
Disallow */help-center/symptom-check/*

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://www.schaer.com/cs-cz/sitemap-index.xml
sitemap https://www.schaer.com/da-dk/sitemap-index.xml
sitemap https://www.schaer.com/de-at/sitemap-index.xml
sitemap https://www.schaer.com/de-ch/sitemap-index.xml
sitemap https://www.schaer.com/de-de/sitemap-index.xml
sitemap https://www.schaer.com/el-gr/sitemap-index.xml
sitemap https://www.schaer.com/en-ca/sitemap-index.xml
sitemap https://www.schaer.com/en-int/sitemap-index.xml
sitemap https://www.schaer.com/en-uk/sitemap-index.xml
sitemap https://www.schaer.com/en-us/sitemap-index.xml
sitemap https://www.schaer.com/es-ar/sitemap-index.xml
sitemap https://www.schaer.com/es-es/sitemap-index.xml
sitemap https://www.schaer.com/es-int/sitemap-index.xml
sitemap https://www.schaer.com/es-mx/sitemap-index.xml
sitemap https://www.schaer.com/fi-fi/sitemap-index.xml
sitemap https://www.schaer.com/fr-be/sitemap-index.xml
sitemap https://www.schaer.com/fr-fr/sitemap-index.xml
sitemap https://www.schaer.com/hu-hu/sitemap-index.xml
sitemap https://www.schaer.com/it-it/sitemap-index.xml
sitemap https://www.schaer.com/nb-no/sitemap-index.xml
sitemap https://www.schaer.com/nl-be/sitemap-index.xml
sitemap https://www.schaer.com/nl-nl/sitemap-index.xml
sitemap https://www.schaer.com/pl-pl/sitemap-index.xml
sitemap https://www.schaer.com/pt-br/sitemap-index.xml
sitemap https://www.schaer.com/pt-pt/sitemap-index.xml
sitemap https://www.schaer.com/ro-ro/sitemap-index.xml
sitemap https://www.schaer.com/ru-ru/sitemap-index.xml
sitemap https://www.schaer.com/sk-sk/sitemap-index.xml
sitemap https://www.schaer.com/sl-si/sitemap-index.xml
sitemap https://www.schaer.com/sv-se/sitemap-index.xml
sitemap https://www.schaer.com/tr-tr/sitemap-index.xml

Comments

  • robots.txt
  • This file is to prevent the crawling and indexing of certain parts
  • of your site by web crawlers and spiders run by sites like Yahoo!
  • and Google. By telling these "robots" where not to go on your site,
  • you save bandwidth and server resources.
  • This file will be ignored unless it is at the root of your host:
  • Used: http://example.com/robots.txt
  • Ignored: http://example.com/site/robots.txt
  • For more information about the robots.txt standard, see:
  • http://www.robotstxt.org/robotstxt.html
  • CSS, JS, Images
  • Directories
  • Files
  • Paths (clean URLs)
  • Paths (no clean URLs)
  • Robots delay
  • General search
  • Product search translations