algaida.es
robots.txt

Robots Exclusion Standard data for algaida.es

Resource Scan

Scan Details

Site Domain algaida.es
Base Domain algaida.es
Scan Status Ok
Last Scan2025-12-17T20:33:05+00:00
Next Scan 2026-01-16T20:33:05+00:00

Last Scan

Scanned2025-12-17T20:33:05+00:00
URL https://algaida.es/robots.txt
Domain IPs 151.101.1.91, 151.101.129.91, 151.101.193.91, 151.101.65.91
Response IP 151.101.193.91
Found Yes
Hash 1f0a85c0315fd00b9dbe535c345ffddbeb07293c1caa829564df6266ee5f440c
SimHash 041c1861ef40

Groups

*

Rule Path
Disallow /admin
Disallow /.git/

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /do-not-crawl/

*

Rule Path
Disallow /not-allowed/