wohnen.de
robots.txt

Robots Exclusion Standard data for wohnen.de

Resource Scan

Scan Details

Site Domain wohnen.de
Base Domain wohnen.de
Scan Status Ok
Last Scan2024-06-23T06:25:24+00:00
Next Scan 2024-07-23T06:25:24+00:00

Last Scan

Scanned2024-06-23T06:25:24+00:00
URL https://wohnen.de/robots.txt
Redirect https://www.wohnen.de/robots.txt
Redirect Domain www.wohnen.de
Redirect Base wohnen.de
Domain IPs 109.71.73.34
Redirect IPs 109.71.73.34
Response IP 109.71.73.34
Found Yes
Hash 1ee715e831312c04f035bf1cb3299c81f88aec13b099f05a75f2dc2a33aec645
SimHash 1a7d8d5b6889

Groups

*

Rule Path
Disallow /index.php/
Disallow /404/
Disallow /admin/
Disallow /lieferverlauf
Disallow /account/
Disallow /search
Disallow /techdaten/

ahrefsbot
semrushbot
blexbot
dotbot
mj12bot
barkrowler
sistrix
optimizer
seznambot
qwantify
researchbot
ltx71
awooo
seoscanners
ssearch
spbot
yandexbot
seokicks
adscanner
baiduspider
cliqzbot
aihitbot
qwantify
xovi
searchmetricsbot
backlinkcrawler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.wohnen.de/sitemap.xml
sitemap https://www.wohnen.de/sitemapKategorie_0.xml
sitemap https://www.wohnen.de/sitemapBilder_0.xml
sitemap https://www.wohnen.de/sitemapFilter_0.xml
sitemap https://www.wohnen.de/sitemapProdukt_0.xml