cryptoast.fr
robots.txt

Robots Exclusion Standard data for cryptoast.fr

Resource Scan

Scan Details

Site Domain cryptoast.fr
Base Domain cryptoast.fr
Scan Status Ok
Last Scan2025-12-30T14:37:46+00:00
Next Scan 2026-01-06T14:37:46+00:00

Last Scan

Scanned2025-12-30T14:37:46+00:00
URL https://cryptoast.fr/robots.txt
Domain IPs 104.26.10.68, 104.26.11.68, 172.67.73.116, 2606:4700:20::681a:a44, 2606:4700:20::681a:b44, 2606:4700:20::ac43:4974
Response IP 172.67.73.116
Found Yes
Hash 2688e874ad1ec4567dc459ffcaf9d8bdc8571da7e02aff9b3eab7c6529767112
SimHash 4b0088008fb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
sitemap https://cryptoast.fr/sitemap_index.xml
sitemap https://cryptoast.fr/news-sitemap.xmlUser-agent: CCBotDisallow: /User-agent: ChatGPT-UserDisallow: /User-agent: GPTBotDisallow: /User-agent: OmgilibotDisallow: /User-agent: FacebookBotDisallow: /