iw.de
robots.txt

Robots Exclusion Standard data for iw.de

Resource Scan

Scan Details

Site Domain iw.de
Base Domain iw.de
Scan Status Ok
Last Scan2024-11-13T09:28:43+00:00
Next Scan 2024-11-20T09:28:43+00:00

Last Scan

Scanned2024-11-13T09:28:43+00:00
URL http://iw.de/robots.txt
Redirect https://www.immowelt.de/robots.txt
Redirect Domain www.immowelt.de
Redirect Base immowelt.de
Domain IPs 18.194.219.135, 52.29.119.60, 54.93.192.163
Redirect IPs 3.160.196.49, 3.160.196.81, 3.160.196.89, 3.160.196.99
Response IP 18.165.122.79
Found Yes
Hash 2de1ce78983a81a5f01217410fa3fdcf5a7b7e7d139d659b618f4b11ebcdcaf7
SimHash 1156c874c3ee

Groups

*

Rule Path
Disallow /1_Components/
Disallow /bin/
Disallow /EMailTemplates/
Disallow /aspnet_Client/
Disallow /_Address/
Disallow /_Estate/
Disallow /_Vacation/
Disallow /_Scripts/
Disallow /_Common/
Disallow /_ContentSpecial/
Disallow /_MedienID/
Disallow /_Gesuche
Disallow /*.axd$
Disallow /*.ashx$
Disallow /sharer/
Disallow /printpdf
Disallow /*/Preis24Data
Disallow /liste/karte
Disallow /produktauswahl/
Disallow /buchung/
Disallow /erfassung/
Disallow /suchauftrag/
Disallow /*/GetAnbieterKontaktanfrageForm
Disallow /*/printrwdpdf
Disallow /*/umfragewohnlagen
Disallow /umzug/preisvergleich*
Disallow /immobilienpreise/*detail*
Disallow /*privacy_policy_url*
Disallow /immobilienfinanzierung-anfragen*
Disallow /old/profil/*
Disallow /expose/*/kontaktanfragegesendet
Disallow /vorschau/expose/*
Disallow /immobilien/jumptooda.aspx?OnlineID=*
Disallow /expose/*/karte
Disallow /beta/expose/*
Disallow /*%28*%28*%29%29
Disallow *?dsiplay=*
Disallow *?display=*
Disallow *mobile%3Dfalse*
Disallow /ausland/search/GetTopRegionsByCategory?*
Disallow /meinefinanzierung
Disallow /liste/getteaser
Disallow /liste/getlistitems
Disallow /_common/userprofileclient/userprofileclient.asmx/UpdateBrowserScreen
Disallow /feedback/widget/feedback-webcomponent.min.js
Disallow /kameleoon/kameleoon-iframe.html
Disallow /_scripts/iwag/common/removewdforced.js
Disallow /liste/getprojecttileobjectitems
Disallow *maklerBanner?undefined&*
Disallow *?variant=cp*
Disallow /suche/*/wg?id=*
Disallow /projekte/expose/k2m3732*
Disallow *usercentrics*
Disallow /classified-search?*
Disallow /classified-map?*

twiceler

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

Other Records

Field Value
sitemap https://www.immowelt.de/index-sitemap-immowelt.xml