iw.de
robots.txt

Robots Exclusion Standard data for iw.de

Resource Scan

Scan Details

Site Domain iw.de
Base Domain iw.de
Scan Status Ok
Last Scan2024-06-26T07:31:46+00:00
Next Scan 2024-07-03T07:31:46+00:00

Last Scan

Scanned2024-06-26T07:31:46+00:00
URL http://iw.de/robots.txt
Redirect https://www.immowelt.de/robots.txt
Redirect Domain www.immowelt.de
Redirect Base immowelt.de
Domain IPs 18.194.219.135, 52.29.119.60, 54.93.192.163
Redirect IPs 18.154.132.25, 18.154.132.28, 18.154.132.63, 18.154.132.97
Response IP 18.165.171.24
Found Yes
Hash 028edfcbc4e341709e84f0e2ec668b6b72bd6b5aff9e4db3e7af1fa0a9d01604
SimHash 1156c874c3ee

Groups

*

Rule Path
Disallow /1_Components/
Disallow /bin/
Disallow /EMailTemplates/
Disallow /aspnet_Client/
Disallow /_Address/
Disallow /_Estate/
Disallow /_Vacation/
Disallow /_Scripts/
Disallow /_Common/
Disallow /_ContentSpecial/
Disallow /_MedienID/
Disallow /_Gesuche
Disallow /*.axd$
Disallow /*.ashx$
Disallow /sharer/
Disallow /printpdf
Disallow /*/Preis24Data
Disallow /liste/karte
Disallow /produktauswahl/
Disallow /buchung/
Disallow /erfassung/
Disallow /suchauftrag/
Disallow /*/GetAnbieterKontaktanfrageForm
Disallow /*/printrwdpdf
Disallow /*/umfragewohnlagen
Disallow /umzug/preisvergleich*
Disallow /immobilienpreise/*detail*
Disallow /*privacy_policy_url*
Disallow /immobilienfinanzierung-anfragen*
Disallow /old/profil/*
Disallow /expose/*/kontaktanfragegesendet
Disallow /vorschau/expose/*
Disallow /immobilien/jumptooda.aspx?OnlineID=*
Disallow /expose/*/karte
Disallow /beta/expose/*
Disallow /*%28*%28*%29%29
Disallow *?dsiplay=*
Disallow *?display=*
Disallow *mobile%3Dfalse*
Disallow /ausland/search/GetTopRegionsByCategory?*
Disallow /meinefinanzierung
Disallow /liste/getteaser
Disallow /liste/getlistitems
Disallow /_common/userprofileclient/userprofileclient.asmx/UpdateBrowserScreen
Disallow /feedback/widget/feedback-webcomponent.min.js
Disallow /kameleoon/kameleoon-iframe.html
Disallow /_scripts/iwag/common/removewdforced.js
Disallow /liste/getprojecttileobjectitems
Disallow *maklerBanner?undefined&*
Disallow *?variant=cp*
Disallow /suche/*/wg?id=*
Disallow /projekte/expose/k2m3732*
Disallow *usercentrics*

twiceler

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

Other Records

Field Value
sitemap https://www.immowelt.de/index-sitemap-immowelt.xml