mei.agilize.com.br
robots.txt

Robots Exclusion Standard data for mei.agilize.com.br

Resource Scan

Scan Details

Site Domain mei.agilize.com.br
Base Domain agilize.com.br
Scan Status Ok
Last Scan2025-07-26T08:59:19+00:00
Next Scan 2025-08-25T08:59:19+00:00

Last Scan

Scanned2025-07-26T08:59:19+00:00
URL https://mei.agilize.com.br/robots.txt
Domain IPs 13.35.238.19, 13.35.238.23, 13.35.238.31, 13.35.238.9
Response IP 13.35.238.19
Found Yes
Hash ea8e402ac51d950456c05bac52944d33c2c0fa4cc24c629054eb346e4fbcfea4
SimHash 4815d880e392

Groups

*

Rule Path
Disallow /

Comments

  • Example 3: Block all crawlers except AdsBot (AdsBot crawlers must be named explicitly)