Log In Sign Up

casinosbelgie.be
robots.txt

Robots Exclusion Standard data for casinosbelgie.be

Resource Scan

Scan Details

Site Domain casinosbelgie.be
Base Domain casinosbelgie.be
Scan Status Ok
Last Scan2024-04-20T06:08:58+00:00
Next Scan 2024-05-20T06:08:58+00:00

Last Scan

Scanned2024-04-20T06:08:58+00:00
URL https://casinosbelgie.be/robots.txt
Redirect https://www.casinosbelgie.be:443/robots.txt
Redirect Domain www.casinosbelgie.be
Redirect Base casinosbelgie.be
Domain IPs 13.225.4.106, 13.225.4.109, 13.225.4.128, 13.225.4.76, 2600:9000:21b4:3a00:1c:ac53:9580:93a1, 2600:9000:21b4:4200:1c:ac53:9580:93a1, 2600:9000:21b4:5400:1c:ac53:9580:93a1, 2600:9000:21b4:8200:1c:ac53:9580:93a1, 2600:9000:21b4:8800:1c:ac53:9580:93a1, 2600:9000:21b4:9c00:1c:ac53:9580:93a1, 2600:9000:21b4:ac00:1c:ac53:9580:93a1, 2600:9000:21b4:d200:1c:ac53:9580:93a1
Redirect IPs 13.225.4.106, 13.225.4.109, 13.225.4.128, 13.225.4.76, 2600:9000:21b4:1600:1c:ac53:9580:93a1, 2600:9000:21b4:2000:1c:ac53:9580:93a1, 2600:9000:21b4:3a00:1c:ac53:9580:93a1, 2600:9000:21b4:600:1c:ac53:9580:93a1, 2600:9000:21b4:a200:1c:ac53:9580:93a1, 2600:9000:21b4:d600:1c:ac53:9580:93a1, 2600:9000:21b4:e00:1c:ac53:9580:93a1, 2600:9000:21b4:ec00:1c:ac53:9580:93a1
Response IP 13.225.4.106
Found Yes
Hash 8da436a1391058f612c7c088e57fb8bf94fe4acc6b3c49041d143cc7c179caae
SimHash 69000a020b82

Groups

scrapy

Rule Path
Allow /

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Back to top

Other Records

Field Value
sitemap https://www.casinosbelgie.be/sitemap.xml
sitemap https://www.casinosbelgie.be/news-sitemap.xml
Back to top