Log In Sign Up

astel.be
robots.txt

Robots Exclusion Standard data for astel.be

Resource Scan

Scan Details

Site Domain astel.be
Base Domain astel.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-15T17:50:53+00:00
Next Scan 2024-09-13T17:50:53+00:00

Last Successful Scan

Scanned2023-10-27T17:44:34+00:00
URL https://astel.be/robots.txt
Redirect http://www.astel.be:80/robots.txt
Redirect Domain www.astel.be
Redirect Base astel.be
Domain IPs 13.33.88.113, 13.33.88.118, 13.33.88.27, 13.33.88.60, 2600:9000:223b:3800:6:6e95:cf40:93a1, 2600:9000:223b:3a00:6:6e95:cf40:93a1, 2600:9000:223b:4400:6:6e95:cf40:93a1, 2600:9000:223b:4600:6:6e95:cf40:93a1, 2600:9000:223b:4a00:6:6e95:cf40:93a1, 2600:9000:223b:6e00:6:6e95:cf40:93a1, 2600:9000:223b:8a00:6:6e95:cf40:93a1, 2600:9000:223b:8c00:6:6e95:cf40:93a1
Redirect IPs 13.33.88.113, 13.33.88.118, 13.33.88.27, 13.33.88.60, 2600:9000:223b:2200:6:6e95:cf40:93a1, 2600:9000:223b:2800:6:6e95:cf40:93a1, 2600:9000:223b:3000:6:6e95:cf40:93a1, 2600:9000:223b:4e00:6:6e95:cf40:93a1, 2600:9000:223b:7a00:6:6e95:cf40:93a1, 2600:9000:223b:8400:6:6e95:cf40:93a1, 2600:9000:223b:9000:6:6e95:cf40:93a1, 2600:9000:223b:bc00:6:6e95:cf40:93a1
Response IP 18.64.183.29
Found Yes
Hash 6a6d785704ffd5807eca4933e8aab97dddcdb20b80a4a72daae53b9b498f6094
SimHash 52089572e713

Groups

*

Rule Path
Disallow /forums/*
Disallow /forum/*
Disallow /photo/*
Disallow /boutique/*
Disallow /commander*
Disallow /bestellen*
Disallow *jserrors
Allow /
Back to top

Other Records

Field Value
sitemap https://www.astel.be/sitemap.xml
Back to top