oberwerk.com
robots.txt

Robots Exclusion Standard data for oberwerk.com

Resource Scan

Scan Details

Site Domain oberwerk.com
Base Domain oberwerk.com
Scan Status Ok
Last Scan2025-11-12T10:37:50+00:00
Next Scan 2025-12-12T10:37:50+00:00

Last Scan

Scanned2025-11-12T10:37:50+00:00
URL https://oberwerk.com/robots.txt
Domain IPs 104.21.26.199, 172.67.168.131, 2606:4700:3035::6815:1ac7, 2606:4700:3037::ac43:a883
Response IP 172.67.168.131
Found Yes
Hash a62473a0e0fcc5404ba87001aacc611c572f90864189485fc9a27c9baec46f25
SimHash b0049b02eb83

Groups

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

proximcbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

theknowledgeai

Rule Path
Disallow /

smartcrawl seo audit 1.0

Rule Path
Allow /

*

Rule Path
Disallow
Disallow /*add-to-cart%3D*
Disallow /cart/
Disallow /checkout/
Disallow /my-account/

*

Rule Path
Disallow /e61467691bc20425

Other Records

Field Value
sitemap https://oberwerk.com/sitemap.xml

Comments

  • WP Defender - Begin
  • WP Defender - End