Log In Sign Up

coin-update.de
robots.txt

Robots Exclusion Standard data for coin-update.de

Resource Scan

Scan Details

Site Domain coin-update.de
Base Domain coin-update.de
Scan Status Ok
Last Scan2024-09-25T16:34:34+00:00
Next Scan 2024-10-02T16:34:34+00:00

Last Scan

Scanned2024-09-25T16:34:34+00:00
URL https://coin-update.de/robots.txt
Domain IPs 104.21.51.217, 172.67.186.181, 2606:4700:3032::6815:33d9, 2606:4700:3035::ac43:bab5
Response IP 172.67.186.181
Found Yes
Hash 81d872bb3244f171c6f267092927295db326968c80abb058deb812327f128f2a
SimHash 5188ca5184b0

Groups

*

Rule Path
Disallow /wp-admin/
Disallow /wp-content/plugins/
Allow /wp-admin/admin-ajax.php
Allow /wp-content/uploads/

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

newsnow

Rule Path
Disallow /

news-please

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://coin-update.de/news-sitemap.xml
sitemap https://coin-update.de/sitemap_index.xml
Back to top

Comments

  • robots.txt for https://coin-update.de - Bitcoin und Krypto News
  • Data-Mining oder Scraping der Inhalte ohne schriftliche Genehmigung ist verboten.
  • Sitemap for News
  • Complete Sitemap
Back to top