verlag.faz.net
robots.txt

Robots Exclusion Standard data for verlag.faz.net

Resource Scan

Scan Details

Site Domain verlag.faz.net
Base Domain faz.net
Scan Status Ok
Last Scan2024-05-05T16:21:10+00:00
Next Scan 2024-06-04T16:21:10+00:00

Last Scan

Scanned2024-05-05T16:21:10+00:00
URL https://verlag.faz.net/robots.txt
Domain IPs 23.52.113.113
Response IP 184.25.221.148
Found Yes
Hash a49de8807da39f8ec9894d4de3840e148199e7a2dcd4b5b56e82b21c2a5ccac4
SimHash ba000e522dc7

Groups

*

Rule Path
Disallow /p/
Disallow /hilfe/2.335/was-passiert-wenn-ich-keine-cookies-akzeptiere-111553.html
Disallow /*json*
Disallow /*komsuch*
Disallow /d/login/
Disallow /*msrv*
Disallow /print/
Disallow /m/*.swf
Disallow /*Doc~EB091BDD20148490F90F04EE30133DC40~*
Disallow /*-1437134.html*
Disallow /*old4delete/*
Disallow /cmlink/
Disallow /premiumContent
Disallow /followAjaxCall/
Disallow /unfollowAjaxCall/
Disallow /lw3dgf*qxdtpz/
Disallow /*.pdf
Disallow /*.swf
Disallow /preview/www/
Disallow /polopoly_fs/
Disallow /js/adobe/at.js
Disallow */memo-api-add/
Disallow */memo-api-remove/
Disallow */memo-api-ask/
Disallow */amp-ivw.html*
Disallow /redaktion?cache
Disallow *mostclicked.gfn
Disallow /%3Bsuche%3Dartikelsuche/suche/
Disallow /suche/
Disallow *?sort=
Disallow /dist/scripts/main_faz-comment.js
Disallow /html-ajax*
Disallow /livewire*
Disallow *atarget.js
Disallow /allesbeste/*?s=*
Disallow /allesbeste/*%26s%3D*
Disallow */asset-comment-info/*
Disallow /membership/*
Disallow /kaufkompass/wp-admin/
Disallow /kaufkompass/newsticker/
Disallow /kaufkompass/wp-content/ab_api_cache/*
Disallow /kaufkompass/search/
Disallow /kaufkompass/*?p=*
Disallow /kaufkompass/*%26p%3D*
Disallow /kaufkompass/*%26preview%3D*
Allow /kaufkompass/wp-admin/admin-ajax.php

meltwater

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

bloodhound

Rule Path
Disallow /

cydralspider

Rule Path
Disallow /

downloadexpress

Rule Path
Disallow /

gammaspider

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

pimptrain

Rule Path
Disallow /

raven

Rule Path
Disallow /

wapspider

Rule Path
Disallow /

webzinger

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

Comments

  • robots.txt updated 2023-09-29
  • Legal notice: faz.net expressly reserves the right to use its content for commercial text and data mining (§ 44 b UrhG).
  • The use of robots or other automated means to access faz.net or collect or mine data without the express permission of faz.net is strictly prohibited.
  • faz.net may, in its discretion, permit certain automated access to certain faz.net pages.
  • If you would like to apply for permission to crawl faz.net, collect or use data, please email nutzungsrechte@faz.de.