Log In Sign Up

faz.de
robots.txt

Robots Exclusion Standard data for faz.de

Resource Scan

Scan Details

Site Domain faz.de
Base Domain faz.de
Scan Status Ok
Last Scan2024-06-24T16:42:07+00:00
Next Scan 2024-07-01T16:42:07+00:00

Last Scan

Scanned2024-06-24T16:42:07+00:00
URL https://www.faz.de/robots.txt
Redirect https://www.faz.net/robots.txt
Redirect Domain www.faz.net
Redirect Base faz.net
Domain IPs 40.118.6.229
Redirect IPs 23.36.253.193
Response IP 23.195.153.154
Found Yes
Hash 003dd745b8b12f329084a000ec429ea580b94542e838970c610653a898ba039a
SimHash a2004e620dc5

Groups

*

Rule Path
Disallow /json/
Disallow /cmlink/
Disallow /premiumContent
Disallow /*.pdf
Disallow /js/adobe/at.js
Disallow */memo-api-add/
Disallow */memo-api-remove/
Disallow */memo-api-ask/
Disallow /redaktion?cache
Disallow *mostclicked.gfn
Disallow /%3Bsuche%3Dartikelsuche/suche/
Disallow /suche/
Disallow *?sort=
Disallow /dist/scripts/main_faz-comment.js
Disallow /html-ajax*
Disallow /livewire*
Disallow *atarget.js
Disallow */sport-ergebnisse/*/ma*/$
Disallow */sport-ergebnisse/*/co*/$
Disallow /api/collect/
Disallow /allesbeste/*?s=*
Disallow /allesbeste/*%26s%3D*
Disallow */asset-comment-info/*
Disallow /membership/*
Disallow /kaufkompass/wp-admin/
Disallow /kaufkompass/newsticker/
Disallow /kaufkompass/wp-content/ab_api_cache/*
Disallow /kaufkompass/search/
Disallow /kaufkompass/*?p=*
Disallow /kaufkompass/*%26p%3D*
Disallow /kaufkompass/*%26preview%3D*
Allow /kaufkompass/wp-admin/admin-ajax.php

meltwater

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

bloodhound

Rule Path
Disallow /

cydralspider

Rule Path
Disallow /

downloadexpress

Rule Path
Disallow /

gammaspider

Rule Path
Disallow /

objectssearch

Rule Path
Disallow /

pimptrain

Rule Path
Disallow /

raven

Rule Path
Disallow /

wapspider

Rule Path
Disallow /

webzinger

Rule Path
Disallow /

fasterfox

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /
Back to top

Comments

  • robots.txt updated 2024-04-16
  • Legal notice: faz.net expressly reserves the right to use its content for commercial text and data mining (ยง44 b UrhG).
  • The use of robots or other automated means to access faz.net or collect or mine data without the express permission of faz.net is strictly prohibited.
  • faz.net may, in its discretion, permit certain automated access to certain faz.net pages.
  • If you would like to apply for permission to crawl faz.net, collect or use data, please email nutzungsrechte@faz.de.
Back to top