Log In Sign Up

faz-fachverlag.de
robots.txt

Robots Exclusion Standard data for faz-fachverlag.de

Resource Scan

Scan Details

Site Domain faz-fachverlag.de
Base Domain faz-fachverlag.de
Scan Status Ok
Last Scan2024-06-15T01:53:50+00:00
Next Scan 2024-07-15T01:53:50+00:00

Last Scan

Scanned2024-06-15T01:53:50+00:00
URL https://faz-fachverlag.de/robots.txt
Redirect https://www.faz-bm.de//robots.txt
Redirect Domain www.faz-bm.de
Redirect Base faz-bm.de
Domain IPs 2001:8d8:100f:f000::2ee, 217.160.0.46
Redirect IPs 185.125.174.17
Response IP 185.125.174.17
Found Yes
Hash 877ab3a8bbc4e57bd43f6df3531162825d9ab0d7fc79562112df42b27a19c60e
SimHash 92205c3a2db5

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /wp-login.php
Disallow /?s=
Disallow /search/

Other Records

Field Value
crawl-delay 15

blexbot

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

bubing

Rule Path
Disallow /

voltron

Rule Path
Disallow /

yandex

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

mj12bot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

dotbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 50

ninja bot

Rule Path
Disallow /
Back to top

Comments

  • Legal notice: All websites operated by F.A.Z. BUSINESS MEDIA expressly reserves the right to use its content for commercial text and data mining (§ 44b UrhG).
  • The use of robots or other automated means to access any website operated by F.A.Z. BUSINESS MEDIA or collect or mine data without the express permission of F.A.Z. BUSINESS MEDIA is strictly prohibited.
  • F.A.Z. BUSINESS MEDIA may, in its discretion, permit certain automated access to certain pages of its websites.
  • If you would like to apply for permission to crawl any website operated by F.A.Z. BUSINESS MEDIA, collect or use data, please contact nutzungsrechte@faz.de
  • This notice encompasses the following websites but is not limited to them.
  • faz-bm.de, betriebsratspraxis24.de, derneuekaemmerer.de, deutscheranwaltspiegel.de, die-stiftung.de, dpn-online.com, european-economic.eu, faz-konferenzen.de, faz-personaljournal.de, gruenden-wachsen.de, hr-summit.de, institutional-assets.com, personalpraxis24.de, stadtvonmorgen.de, step-award.de, wirmagazin.de
Back to top