hostmf.com.br
robots.txt

Robots Exclusion Standard data for hostmf.com.br

Resource Scan

Scan Details

Site Domain hostmf.com.br
Base Domain hostmf.com.br
Scan Status Ok
Last Scan2025-12-14T02:30:04+00:00
Next Scan 2026-01-13T02:30:04+00:00

Last Scan

Scanned2025-12-14T02:30:04+00:00
URL https://hostmf.com.br/robots.txt
Domain IPs 104.26.6.42, 104.26.7.42, 172.67.68.48, 2606:4700:20::681a:62a, 2606:4700:20::681a:72a, 2606:4700:20::ac43:4430
Response IP 172.67.68.48
Found Yes
Hash eb73c9490353117ad5978f014d84a9a1a68b03ca6d92d44ae9be294eee5756dd
SimHash ab0ecc66aa93

Groups

*

Rule Path
Disallow /central/downloads.php
Disallow /api/
Disallow /includes/
Disallow /templates/
Disallow /*.json$
Disallow /CLAUDE.md

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap https://hostmf.com.br/sitemap.xml

Comments

  • Crawl-delay
  • Sitemap