schmersal.com
robots.txt

Robots Exclusion Standard data for schmersal.com

Resource Scan

Scan Details

Site Domain schmersal.com
Base Domain schmersal.com
Scan Status Ok
Last Scan2024-09-21T06:47:57+00:00
Next Scan 2024-10-21T06:47:57+00:00

Last Scan

Scanned2024-09-21T06:47:57+00:00
URL https://schmersal.com/robots.txt
Redirect https://www.schmersal.com/robots.txt
Redirect Domain www.schmersal.com
Redirect Base schmersal.com
Domain IPs 85.214.103.80
Redirect IPs 118.215.81.44
Response IP 23.15.144.22
Found Yes
Hash 67fca18decfb63a675ce0dc51e02dd4e3fe0adb997676e8de97ca6e3e08c2ad9
SimHash 29148b904071

Groups

*

Rule Path
Allow /
Disallow /*?id=*
Disallow /*?content*
Disallow /*?cms*

surveybot

Rule Path
Disallow /

websitewiki

Rule Path
Disallow /

shopwiki

Rule Path
Disallow /

jakarta commons-httpclient

Rule Path
Disallow /

aboutusbot

Rule Path
Disallow /

semager

Rule Path
Disallow /

linguee

Rule Path
Disallow /

updownerbot

Rule Path
Disallow /

zeusbot

Rule Path
Disallow /

gonzo

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Allow /

*

Rule Path
Disallow /*?print$

Other Records

Field Value
sitemap https://www.schmersal.com/home/sitemap.xml