bitlibre.net
robots.txt

Robots Exclusion Standard data for bitlibre.net

Resource Scan

Scan Details

Site Domain bitlibre.net
Base Domain bitlibre.net
Scan Status Ok
Last Scan2025-12-22T03:48:37+00:00
Next Scan 2026-01-05T03:48:37+00:00

Last Scan

Scanned2025-12-22T03:48:37+00:00
URL https://bitlibre.net/robots.txt
Redirect https://www.centric.eu/robots.txt
Redirect Domain www.centric.eu
Redirect Base centric.eu
Domain IPs 104.18.18.127, 104.18.19.127, 2606:4700::6812:127f, 2606:4700::6812:137f
Redirect IPs 13.69.68.21
Response IP 13.69.68.21
Found Yes
Hash b5f1ddecde5300bf7525352d3c1ec8919e6aaa3b3d94d8d715d0617eaf825205
SimHash cb5d5523ef92

Groups

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

adstxtcrawlertp

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

nmap scripting engine

Rule Path
Disallow /

opentheboxbot/1.0

Rule Path
Disallow /

*

Rule Path
Disallow /nl/zoeken/
Disallow /no/s%C3%B8k/
Disallow /se/s%C3%B6k/
Disallow /de/suche/
Disallow /be/fr/rechercher/
Disallow /be/nl/zoeken/
Disallow /ro/search/
Disallow /lt/search/
Disallow /en/search/

Other Records

Field Value
sitemap https://centric.eu/sitemap.xml