astelav.com
robots.txt

Robots Exclusion Standard data for astelav.com

Resource Scan

Scan Details

Site Domain astelav.com
Base Domain astelav.com
Scan Status Ok
Last Scan2026-01-28T02:00:05+00:00
Next Scan 2026-02-27T02:00:05+00:00

Last Scan

Scanned2026-01-28T02:00:05+00:00
URL https://astelav.com/robots.txt
Redirect https://www.astelav.com/robots.txt
Redirect Domain www.astelav.com
Redirect Base astelav.com
Domain IPs 85.159.150.50
Redirect IPs 104.26.12.25, 104.26.13.25, 172.67.75.68, 2606:4700:20::681a:c19, 2606:4700:20::681a:d19, 2606:4700:20::ac43:4b44
Response IP 104.26.13.25
Found Yes
Hash e1addd2fe208adfe19b88ae8d34a7cf36f35a5bcde31bdc3e4ab3b3831a8b96d
SimHash 8f60c8906330

Groups

*

Rule Path
Disallow /admin
Disallow /classes
Disallow /config
Disallow /filemanager
Disallow /gallery
Disallow /inc_sito

Other Records

Field Value
crawl-delay 10

petalbot

Rule Path
Disallow /