Log In Sign Up

refurbished.be
robots.txt

Robots Exclusion Standard data for refurbished.be

Resource Scan

Scan Details

Site Domain refurbished.be
Base Domain refurbished.be
Scan Status Ok
Last Scan2026-02-08T05:30:03+00:00
Next Scan 2026-03-10T05:30:03+00:00

Last Scan

Scanned2026-02-08T05:30:03+00:00
URL https://refurbished.be/robots.txt
Redirect https://www.refurbished.be/robots.txt
Redirect Domain www.refurbished.be
Redirect Base refurbished.be
Domain IPs 104.21.31.197, 172.67.179.166, 2606:4700:3030::6815:1fc5, 2606:4700:3031::ac43:b3a6
Redirect IPs 104.21.31.197, 172.67.179.166, 2606:4700:3030::6815:1fc5, 2606:4700:3031::ac43:b3a6
Response IP 172.67.179.166
Found Yes
Hash 212650f567b9d3209317b0719e2d6a4053058002e8dd4b55f4a25c737e60cc5e
SimHash 481d9c83f952

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://www.refurbished.be/cache/xml/sitemap-4.xml
Back to top

Warnings

  • 1 invalid line.
  • `www.refurbished.nl.txtuser-agent` is not a known field.
Back to top