nookdiscovery.com
robots.txt

Robots Exclusion Standard data for nookdiscovery.com

Resource Scan

Scan Details

Site Domain nookdiscovery.com
Base Domain nookdiscovery.com
Scan Status Ok
Last Scan2026-02-21T16:52:09+00:00
Next Scan 2026-02-28T16:52:09+00:00

Last Scan

Scanned2026-02-21T16:52:09+00:00
URL https://nookdiscovery.com/robots.txt
Redirect https://www.nookdiscovery.com/robots.txt
Redirect Domain www.nookdiscovery.com
Redirect Base nookdiscovery.com
Domain IPs 104.18.10.142, 104.18.11.142, 2606:4700::6812:a8e, 2606:4700::6812:b8e
Redirect IPs 104.18.10.142, 104.18.11.142, 2606:4700::6812:a8e, 2606:4700::6812:b8e
Response IP 104.18.11.142
Found Yes
Hash edd5995b6ab97f8ba46d273655e5e8c02e59711c6f9fc9c853f2958542c48a0a
SimHash 0974c8101b10

Groups

*

Rule Path
Disallow /*about.html$
Disallow /*contact.html$
Disallow /*guidance.html$
Disallow /*disclaimer.html$
Disallow /*dmca.html$
Disallow /*privacyPolicy.html$
Disallow /*rules.html$
Disallow /search
Disallow /*/search

baiduspider*
sogou*

Rule Path
Disallow /

scrapy
ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.nookdiscovery.com/sitemap.xml