agil8.com
robots.txt

Groups

amazonbot

applebot-extended

bytespider

ccbot

claudebot

google-extended

gptbot

meta-externalagent

teleport

teleportpro

emailcollector

emailsiphon

webbandit

webzip

webreaper

webstripper

web downloader

ahrefsbot

semrushbot

mj12bot

webcopier

offline explorer pro

offline explorer

httrack website copier

offline commander

leech

websnake

blackwidow

http weazel

*

Comments

• As a condition of accessing this website, you agree to abide by the following
• content-usage signals:
• (a) If a content-usage signal = yes, you may collect content for the
• corresponding use.
• (b) If a content-usage signal = no, you may not collect content for the
• corresponding use.
• (c) If the website operator does not include a content-usage signal for a
• corresponding use, the website operator neither grants nor restricts
• permission via content-usage signal with respect to the corresponding
• use.
• The content-usage signals and their meanings are:
• search: building a search index and providing search results (e.g., returning
• hyperlinks and short excerpts from your website's contents). Search
• does not include providing AI-generated search summaries.
• ai-input: inputting content into one or more AI models (e.g., retrieval
• augmented generation, grounding, or other real-time taking of
• content for generative AI search answers).
• ai-train: training or fine-tuning AI models.
• ANY RESTRICTIONS EXPRESSED VIA CONTENT-USAGE SIGNALS ARE EXPRESS
• RESERVATIONS OF RIGHTS UNDER ARTICLE 4 OF THE EUROPEAN UNION DIRECTIVE
• 2019/790 ON COPYRIGHT AND RELATED RIGHTS IN THE DIGITAL SINGLE MARKET.
• BEGIN Cloudflare Managed content
• END Cloudflare Managed Content