haxor.id
robots.txt

Robots Exclusion Standard data for haxor.id

Resource Scan

Scan Details

Site Domain haxor.id
Base Domain haxor.id
Scan Status Ok
Last Scan2025-12-23T11:32:39+00:00
Next Scan 2025-12-30T11:32:39+00:00

Last Scan

Scanned2025-12-23T11:32:39+00:00
URL https://haxor.id/robots.txt
Domain IPs 104.21.19.46, 172.67.185.57, 2606:4700:3030::ac43:b939, 2606:4700:3033::6815:132e
Response IP 104.21.19.46
Found Yes
Hash c0c615cbba3981385b2a29a4cd1c84b44d6f0d098faeac3958c4a0d189555df2
SimHash 2155d94c5a28

Groups

googlebot

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /404
Disallow /403
Disallow /webmin
Disallow /home

googlebot-image

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /404
Disallow /403
Disallow /webmin
Disallow /home

apis-google

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /404
Disallow /403
Disallow /webmin
Disallow /home

adsbot-google

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /webmin

adsbot-google-mobile

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /webmin

mediapartners-google

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /webmin

mj12bot

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /404
Disallow /403
Disallow /webmin
Disallow /home

*

Rule Path
Allow /
Allow /mirror/
Allow /archive
Allow /archive/special
Allow /archive/onhold
Allow /archive/attacker/
Allow /archive/team/
Allow /archive/ip/
Allow /archive/domain/
Allow /attacker/rank
Allow /team/rank
Allow /stats
Allow /contactus
Allow /about
Allow /terms
Allow /search
Disallow /404
Disallow /403
Disallow /webmin
Disallow /home