wlw.de
robots.txt

Robots Exclusion Standard data for wlw.de

Resource Scan

Scan Details

Site Domain wlw.de
Base Domain wlw.de
Scan Status Ok
Last Scan2024-11-10T22:59:45+00:00
Next Scan 2024-11-17T22:59:45+00:00

Last Scan

Scanned2024-11-10T22:59:45+00:00
URL https://wlw.de/robots.txt
Redirect https://www.wlw.de:443/robots.txt
Redirect Domain www.wlw.de
Redirect Base wlw.de
Domain IPs 18.192.91.172, 52.28.227.242, 52.59.139.184
Redirect IPs 18.196.49.216, 3.126.158.228, 35.156.132.137
Response IP 3.126.158.228
Found Yes
Hash a1a11bb44efb2cccb616cb87ebc120b80cadd3c408ca60aa8e49460dcc5f52db
SimHash 02661ed40a57

Groups

mediapartners-google

Rule Path
Disallow

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

*

Rule Path
Disallow /extern/adm-images/
Disallow /sse/
Disallow /internal_api/
Disallow /picture500/
Disallow *cp_print*
Disallow */suche/ui5-*
Disallow */inside-business/checkip
Disallow */vergleichen?*
Disallow *login?*
Disallow *oauth2/*
Disallow *?category=null*
Disallow *?q=*
Disallow *?*&q=*
Disallow */produkte*?*
Disallow *?previewAsCustomer=*
Disallow *?*&previewAsCustomer=*
Disallow /de/sustainability
Disallow /*/my-account/*
Disallow /rfq/create
Disallow /request/create
Disallow /.ory/
Disallow /*/registration?*
Disallow /*/supplier-registration?*
Disallow /*/login
Disallow /*/logout
Disallow /*/verification
Disallow /*/user-frontend/*
Disallow /companies/
Disallow /unternehmen/
Disallow /virksomheder/
Disallow /empresas/
Disallow /ettev%C3%83%C2%B5tted/
Disallow /yritykset/
Disallow /entreprises/
Disallow /v%C3%83%C2%A1llalatok/
Disallow /aziende/
Disallow /ondernemingen/
Disallow /bedrifter/
Disallow /empresas/
Disallow /firme/
Disallow /f%C3%83%C2%B6retag/
Disallow /podjetja/
Disallow /bg/
Disallow /cs/
Disallow /da/
Disallow /el/
Disallow /en/
Disallow /es/
Disallow /et/
Disallow /fi/
Disallow /fr/
Disallow /hu/
Disallow /it/
Disallow /lt/
Disallow /lv/
Disallow /nl/
Disallow /no/
Disallow /pl/
Disallow /pt/
Disallow /ro/
Disallow /sl/
Disallow /sv/
Disallow /tr/

Warnings

  • 7 invalid lines.