maskr.io
robots.txt

Groups

*

amazonbot
bytespider
ccbot
meta-externalagent

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Other Records

Comments

• ============================================================================
• CONTENT SIGNAL TERMS AND CONDITIONS
• ============================================================================
• As a condition of accessing this website, you agree to abide by the following
• content signals:
• (a) If a Content-Signal = yes, you may collect content for the corresponding
• use.
• (b) If a Content-Signal = no, you may not collect content for the
• corresponding use.
• (c) If the website operator does not include a Content-Signal for a
• corresponding use, the website operator neither grants nor restricts
• permission via Content-Signal with respect to the corresponding use.
• The content signals and their meanings are:
• search: Building a search index and providing search results (e.g., returning
• hyperlinks and short excerpts from your website's contents). Search
• does not include providing AI-generated search summaries.
• ai-input: Inputting content into one or more AI models (e.g., retrieval
• augmented generation, grounding, or other real-time taking of content
• for generative AI search answers).
• ai-train: Training or fine-tuning AI models.
• ANY RESTRICTIONS EXPRESSED VIA CONTENT SIGNALS ARE EXPRESS RESERVATIONS OF
• RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE 2019/790 ON COPYRIGHT
• AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
• ============================================================================
• BEGIN maskr.io robots configuration
• ============================================================================
• Block impolite AI training bots that might not respect Content-Signal directives
• Block non helpful bots

Warnings

• `content-signal` is not a known field.