search.nookdiscovery.com
robots.txt

Robots Exclusion Standard data for search.nookdiscovery.com

Resource Scan

Scan Details

Site Domain search.nookdiscovery.com
Base Domain nookdiscovery.com
Scan Status Ok
Last Scan2026-02-04T02:36:38+00:00
Next Scan 2026-03-06T02:36:38+00:00

Last Scan

Scanned2026-02-04T02:36:38+00:00
URL https://search.nookdiscovery.com/robots.txt
Domain IPs 104.18.10.142, 104.18.11.142, 2606:4700::6812:a8e, 2606:4700::6812:b8e
Response IP 104.18.10.142
Found Yes
Hash 2df23ca967e7d5a0ea7abcd7edbab99c062030b8174866040d599fc68b1c5142
SimHash 295cc8102f12

Groups

*

Rule Path
Disallow /*about.html$
Disallow /*contact.html$
Disallow /*guidance.html$
Disallow /*disclaimer.html$
Disallow /*dmca.html$
Disallow /*privacyPolicy.html$
Disallow /*rules.html$
Disallow /search
Disallow /*/search

baiduspider*
sogou*

Rule Path
Disallow /

scrapy
ahrefsbot
blexbot
ccbot
cliqzbot
dotbot
ia_archiver
mbcrawler
mj12bot
photon
linguee

Rule Path
Disallow /

Other Records

Field Value
sitemap https://search.nookdiscovery.com/sitemap.xml