amengees.org
robots.txt

Robots Exclusion Standard data for amengees.org

Resource Scan

Scan Details

Site Domain amengees.org
Base Domain amengees.org
Scan Status Ok
Last Scan2025-08-25T19:18:00+00:00
Next Scan 2025-09-24T19:18:00+00:00

Last Scan

Scanned2025-08-25T19:18:00+00:00
URL https://amengees.org/robots.txt
Redirect https://www.amengees.org/robots.txt
Redirect Domain www.amengees.org
Redirect Base amengees.org
Domain IPs 51.91.139.53
Redirect IPs 51.91.139.53
Response IP 51.91.139.53
Found Yes
Hash 229045063d88f0556898b5e07ed6a2f61867d28f6bac8a451b5d2456439cea74
SimHash 685d9e00f093

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

apache-httpclient/4.5.3-snapshot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

thesis-research-bot

Rule Path
Disallow /

fidget-spinner-bot

Rule Path
Disallow /

my-tiny-bot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

*

Rule Path
Disallow /sitemap

*

Rule Path
Disallow /search

*

Rule Path
Disallow /gene/

Other Records

Field Value
sitemap /sitemap.xml