antihuman.cl
robots.txt

Robots Exclusion Standard data for antihuman.cl

Resource Scan

Scan Details

Site Domain antihuman.cl
Base Domain antihuman.cl
Scan Status Ok
Last Scan2026-01-28T20:48:39+00:00
Next Scan 2026-02-27T20:48:39+00:00

Last Scan

Scanned2026-01-28T20:48:39+00:00
URL https://antihuman.cl/robots.txt
Redirect https://antihuman.cl/robots-antihuman.txt
Domain IPs 104.26.6.168, 104.26.7.168, 172.67.71.133, 2606:4700:20::681a:6a8, 2606:4700:20::681a:7a8, 2606:4700:20::ac43:4785
Response IP 104.26.7.168
Found Yes
Hash dcfbd86ca71c8cca6e755c2351b950574e877e7520443c637d315ff3816257de
SimHash 3c515f16edfa

Groups

*

Rule Path
Disallow /cart
Disallow /checkout
Disallow /my-account
Disallow /login
Disallow /*query%3D

cazoodlebot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot/1.0

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://antihuman.cl/sitemap.xml

Comments

  • For all robots
  • Block access to specific groups of pages
  • Allow search crawlers to discover the sitemap
  • Block CazoodleBot as it does not present correct accept content headers
  • Block MJ12bot as it is just noise
  • Block dotbot as it cannot parse base urls properly
  • Block Gigabot