goedkoopste-reizen.be
robots.txt

Robots Exclusion Standard data for goedkoopste-reizen.be

Resource Scan

Scan Details

Site Domain goedkoopste-reizen.be
Base Domain goedkoopste-reizen.be
Scan Status Ok
Last Scan4/22/2025, 1:35:47 AM
Next Scan 4/29/2025, 1:35:47 AM

Last Scan

Scanned4/22/2025, 1:35:47 AM
URL https://goedkoopste-reizen.be/robots.txt
Domain IPs 104.21.64.150, 172.67.152.32, 2606:4700:3032::6815:4096, 2606:4700:3037::ac43:9820
Response IP 172.67.152.32
Found Yes
Hash ae555cb393856bb2167d327dc3da5f18e69e830c310f977bcd3bc27586c1bf06
SimHash 6f2d7c05c6c2

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://www.goedkoopste-reizen.be/sitemap_index.xml

Warnings

  • 2 invalid lines.