Log In Sign Up

casinosbelgie.be
robots.txt

Robots Exclusion Standard data for casinosbelgie.be

Resource Scan

Scan Details

Site Domain casinosbelgie.be
Base Domain casinosbelgie.be
Scan Status Ok
Last Scan2024-10-17T13:27:36+00:00
Next Scan 2024-11-16T13:27:36+00:00

Last Scan

Scanned2024-10-17T13:27:36+00:00
URL https://casinosbelgie.be/robots.txt
Redirect https://www.casinosbelgie.be:443/robots.txt
Redirect Domain www.casinosbelgie.be
Redirect Base casinosbelgie.be
Domain IPs 13.225.4.106, 13.225.4.109, 13.225.4.128, 13.225.4.76, 2600:9000:21b4:1800:1c:ac53:9580:93a1, 2600:9000:21b4:2200:1c:ac53:9580:93a1, 2600:9000:21b4:4200:1c:ac53:9580:93a1, 2600:9000:21b4:5a00:1c:ac53:9580:93a1, 2600:9000:21b4:6800:1c:ac53:9580:93a1, 2600:9000:21b4:8000:1c:ac53:9580:93a1, 2600:9000:21b4:8e00:1c:ac53:9580:93a1, 2600:9000:21b4:c00:1c:ac53:9580:93a1
Redirect IPs 13.225.4.106, 13.225.4.109, 13.225.4.128, 13.225.4.76, 2600:9000:21b4:3e00:1c:ac53:9580:93a1, 2600:9000:21b4:5800:1c:ac53:9580:93a1, 2600:9000:21b4:6e00:1c:ac53:9580:93a1, 2600:9000:21b4:8400:1c:ac53:9580:93a1, 2600:9000:21b4:8e00:1c:ac53:9580:93a1, 2600:9000:21b4:a200:1c:ac53:9580:93a1, 2600:9000:21b4:f000:1c:ac53:9580:93a1, 2600:9000:21b4:f600:1c:ac53:9580:93a1
Response IP 13.225.4.128
Found Yes
Hash 8da436a1391058f612c7c088e57fb8bf94fe4acc6b3c49041d143cc7c179caae
SimHash 69000a020b82

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://www.casinosbelgie.be/sitemap.xml
sitemap https://www.casinosbelgie.be/news-sitemap.xml
Back to top