nodesventure.com
robots.txt

Robots Exclusion Standard data for nodesventure.com

Resource Scan

Scan Details

Site Domain nodesventure.com
Base Domain nodesventure.com
Scan Status Ok
Last Scan2025-12-02T18:53:57+00:00
Next Scan 2025-12-09T18:53:57+00:00

Last Scan

Scanned2025-12-02T18:53:57+00:00
URL https://nodesventure.com/robots.txt
Redirect https://www.nodesventure.com/robots.txt
Redirect Domain www.nodesventure.com
Redirect Base nodesventure.com
Domain IPs 104.18.30.218, 104.18.31.218, 2606:4700::6812:1eda, 2606:4700::6812:1fda
Redirect IPs 104.18.30.218, 104.18.31.218, 2606:4700::6812:1eda, 2606:4700::6812:1fda
Response IP 104.18.30.218
Found Yes
Hash 6c5fce25dc631f6af9230d0e30bf76613566272d889d98fc1b88efaf78581729
SimHash 0974c810fb10

Groups

*

Rule Path
Disallow /*about.html$
Disallow /*contact.html$
Disallow /*guidance.html$
Disallow /*disclaimer.html$
Disallow /*dmca.html$
Disallow /*privacyPolicy.html$
Disallow /*rules.html$
Disallow /search
Disallow /*/search

baiduspider*
sogou*

Rule Path
Disallow /

scrapy
ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nodesventure.com/sitemap.xml