luxevastgoed.be
robots.txt

Robots Exclusion Standard data for luxevastgoed.be

Resource Scan

Scan Details

Site Domain luxevastgoed.be
Base Domain luxevastgoed.be
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-06-04T14:14:23+00:00
Next Scan 2024-09-02T14:14:23+00:00

Last Successful Scan

Scanned2023-10-14T11:57:45+00:00
URL https://luxevastgoed.be/robots.txt
Domain IPs 2600:1413:b000:6::17d5:2bc8, 2600:1413:b000:6::17d5:2bca, 96.17.96.13, 96.17.96.20
Response IP 23.44.4.169
Found Yes
Hash 324406cebc06b925205841aa8c54a7210d5dbd0f7c89f708d2dc2352294c07f2
SimHash 6d204d206133

Groups

*

Rule Path
Disallow /*?utm=*
Disallow /*?pdf

Comments

  • www.robotstxt.org/
  • Allow crawling of all content