amateurmex.com
robots.txt

Robots Exclusion Standard data for amateurmex.com

Resource Scan

Scan Details

Site Domain amateurmex.com
Base Domain amateurmex.com
Scan Status Ok
Last Scan2026-02-14T03:03:44+00:00
Next Scan 2026-03-16T03:03:44+00:00

Last Scan

Scanned2026-02-14T03:03:44+00:00
URL https://amateurmex.com/robots.txt
Redirect https://www.amateurmex.com/robots.txt
Redirect Domain www.amateurmex.com
Redirect Base amateurmex.com
Domain IPs 104.21.69.84, 172.67.206.134, 2606:4700:3035::6815:4554, 2606:4700:3035::ac43:ce86
Redirect IPs 104.21.69.84, 172.67.206.134, 2606:4700:3035::6815:4554, 2606:4700:3035::ac43:ce86
Response IP 104.21.69.84
Found Yes
Hash e5c3a37d949e216fb13a5154a34e25e2a1ef8991f2bf9a08f4612224aae489f1
SimHash 2248d8808303

Groups

jeeves

Rule Path
Disallow /

slurp

Rule Path
Disallow /

yahoo-mmcrawler

Rule Path
Disallow /

msnbot

Rule Path
Disallow /

psbot

Rule Path
Disallow /

*

Rule Path
Disallow /*.jpg$
Disallow /*.Jpg$
Disallow /*.JPG$
Disallow /*.jpeg$
Disallow /*.Jpeg$
Disallow /*.JPEG$