willhaben.at
robots.txt
Robots Exclusion Standard data for willhaben.at
Resource Scan
Scan Details
| Site Domain | willhaben.at |
| Base Domain | willhaben.at |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-04-29T11:19:28+00:00 |
| Next Scan | 2024-05-13T11:19:28+00:00 |
Last Successful Scan
| Scanned | 2024-04-14T11:18:53+00:00 |
| URL | https://willhaben.at/robots.txt |
| Redirect | https://www.willhaben.at/robots.txt |
| Redirect Domain | www.willhaben.at |
| Redirect Base | willhaben.at |
| Domain IPs | 193.22.104.2 |
| Redirect IPs | 193.22.104.2 |
| Response IP | 193.22.104.2 |
| Found | Yes |
| Hash | 289db4c6eafd34cafa2ef860a8ee13d3fe54400bb23bea0f91baac926c62e33a |
| SimHash | 6b59d79303cd |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*?*counterId=* |
| Disallow | /*?*PRICE_FROM=* |
| Disallow | /*?*SEGMENT=* |
| Disallow | /*?*TYPE=* |
| Disallow | /*?*keyword=* |
| Disallow | /*?*periode=* |
| Disallow | /*?*PRICE_TO=* |
| Disallow | /*?*sid= |
| Disallow | /*%3Bjsessionid%3D* |
| Disallow | /iad/admin |
| Disallow | /iad/myprofile |
| Disallow | /iad/searchagent |
| Disallow | /mob/ |
| Disallow | /pal/ |
| Disallow | /rest/ |
| Disallow | /webapi/ |
| Disallow | /jobs/webapi/ |
| Disallow | /restapi/ |
| Disallow | /ajax/ |
| Disallow | /iad/help |
| Disallow | /iad/gohlp |
| Disallow | /iad/gojsp |
| Disallow | /iad/reportad*/ |
| Disallow | /iad/bap/ |
| Allow | /iad/bap/object |
| Disallow | /*iadinstance.*/ |
| Disallow | /iad/contactadvertiser |
| Disallow | /jobs/suche*?similarAdvert* |
| Disallow | /jobs/suche?* |
| Disallow | /*?areaText* |
| Disallow | /*?ENGINE_CYLINDER* |
| Disallow | /*?ENGINE_VOLUME_FROM* |
| Disallow | /*?ENGINE_VOLUME_TO* |
| Disallow | /*?ENGINEEFFECT_FROM* |
| Disallow | /*?ENGINEEFFECT_TO* |
| Disallow | /*?ISPRIVATE* |
| Disallow | /*?MC_EQUIPMENT* |
| Disallow | /*?MILEAGE_FROM* |
| Disallow | /*?MILEAGE_TO* |
| Disallow | /*?MOTOR_CONDITION* |
| Disallow | /*?NO_OF_DOORS_FROM* |
| Disallow | /*?NO_OF_SEATS_FROM* |
| Disallow | /*?NO_OF_SEATS_TO* |
| Disallow | /*?result* |
| Disallow | /*?TRANSMISSION* |
| Disallow | /*?WARRANTY* |
| Disallow | /*?WHEEL_DRIVE* |
| Disallow | /*?YEAR_MODEL_FROM* |
| Disallow | /*?YEAR_MODEL_TO* |
| Disallow | /*?CAR_MODEL* |
| Disallow | /iad/kaufen-und-verkaufen/verkaeuferprofil/* |
| Disallow | /iad/productlink/* |
| Disallow | /*?redirect=1 |
| Disallow | /*sfId%3D* |
| Disallow | /*isNavigation%3D* |
| Disallow | /*VAN_MODEL* |
| Disallow | /*ENGINE/EFFECT* |
| Disallow | /*?adId=* |
| Disallow | /*%26adId%3D* |
| Disallow | /*groupId%3D* |
| Disallow | /*Maxi-Upload* |
| Disallow | /*facebook.com* |
| Disallow | /*instagram.com* |
| Disallow | /*TYPE_OF_SALE* |
| Disallow | /*SUB_AREA_ID%3D* |
| Disallow | /*recommendmailformajax* |
| Disallow | /*mailformajax* |
| Disallow | /*ESTATE_SIZE* |
| Disallow | /*nonewsearch%3D* |
| Disallow | /*ESTATE_PREFERENCE%3D* |
| Disallow | /*AVAILABLETODAY%3D* |
| Disallow | /map/* |
| Disallow | /reportad/* |
| Disallow | |
| Disallow | /*/mapobject* |
| Disallow | /*/immobilien/projekt/* |
| Disallow | /*/gebrauchtwagen/verkaeuferprofil/* |
| Disallow | /*/immobilien/verkaeuferprofil/* |
| Disallow | /sellerprofile/ |
| Disallow | /atverz/ |
| Disallow | /adservices/ |
| Disallow | /logevent/ |
| Disallow | /profile/ |
| Disallow | /userfolders/ |
| Disallow | /*treeAttributes%3D* |
| Disallow | /iad/notfound* |
| Disallow | /*---------* |
| Disallow | /*/null-* |
| Disallow | /*undefined* |
| Disallow | /*force%3Dtrue* |
| Disallow | /iad/kaufen-und-verkaufen/l/*page%3D* |
| Disallow | /iad/kaufen-und-verkaufen/l/*/*page%3D* |
| Disallow | /iad/kaufen-und-verkaufen/l/*browse* |
| Disallow | /iad/kaufen-und-verkaufen/l/*/browse* |
| Disallow | /jobs/login* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-static.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-auto-liste.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-immobilien-liste.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-marktplatz-kategorien.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-marktplatz-kategorien_attribute.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-immobilien-llp.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-marktplatz-llp.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-auto-llp.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-auto-detail.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemapindex-immobilien-detail.xml |
| sitemap | https://www.willhaben.at/sitemap/sitemap_update.xml.gz |
| sitemap | https://www.willhaben.at/jobs/sitemap.xml |
| sitemap | https://www.willhaben.at/will/sitemap.xml |
Comments