amigans.net
robots.txt

Robots Exclusion Standard data for amigans.net

Resource Scan

Scan Details

Site Domain amigans.net
Base Domain amigans.net
Scan Status Ok
Last Scan2025-11-20T19:32:47+00:00
Next Scan 2025-12-20T19:32:47+00:00

Last Scan

Scanned2025-11-20T19:32:47+00:00
URL https://amigans.net/robots.txt
Redirect https://www.amigans.net/robots.txt
Redirect Domain www.amigans.net
Redirect Base amigans.net
Domain IPs 157.180.36.153
Redirect IPs 157.180.36.153
Response IP 157.180.36.153
Found Yes
Hash 693b4234c090ccf62c15ee7e42476a2c485f295e2eab82afa4ee11104d0ad7c7
SimHash 201dbc6060d8

Groups

semrushbot
semrushbot-ba
meta-externalagent
gptbot
mj12bot
bytespider

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/
Disallow /tmp/
Disallow /cache/
Disallow /class/
Disallow /images/
Disallow /include/
Disallow /install/
Disallow /kernel/
Disallow /language/
Disallow /templates_c/
Disallow /themes/
Disallow /uploads/

Other Records

Field Value
crawl-delay 20