dnbcnet.com
robots.txt

Robots Exclusion Standard data for dnbcnet.com

Resource Scan

Scan Details

Site Domain dnbcnet.com
Base Domain dnbcnet.com
Scan Status Ok
Last Scan2026-01-30T10:40:20+00:00
Next Scan 2026-03-01T10:40:20+00:00

Last Scan

Scanned2026-01-30T10:40:20+00:00
URL https://dnbcnet.com/robots.txt
Redirect https://www.dnbcnet.com/robots.txt
Redirect Domain www.dnbcnet.com
Redirect Base dnbcnet.com
Domain IPs 104.18.4.80, 104.18.5.80, 2606:4700::6812:450, 2606:4700::6812:550
Redirect IPs 104.18.4.80, 104.18.5.80, 2606:4700::6812:450, 2606:4700::6812:550
Response IP 104.18.4.80
Found Yes
Hash 0d7fe11385459448d9178a25dc9fe96226f4afe23a43caa42bdcead1a1f85ecd
SimHash a93cae8dc693

Groups

*

Rule Path
Disallow /dashboard/*
Disallow /detect-apps
Disallow /cgi-bin/
Disallow /public/backend/
Disallow /public/frontend/
Disallow /public/shared/

Other Records

Field Value
sitemap https://www.dnbcnet.com/sitemap.xml