nwdb.info
robots.txt

Robots Exclusion Standard data for nwdb.info

Resource Scan

Scan Details

Site Domain nwdb.info
Base Domain nwdb.info
Scan Status Ok
Last Scan2024-09-16T10:40:04+00:00
Next Scan 2024-09-23T10:40:04+00:00

Last Scan

Scanned2024-09-16T10:40:04+00:00
URL https://nwdb.info/robots.txt
Domain IPs 104.22.60.230, 104.22.61.230, 172.67.37.61, 2606:4700:10::6816:3ce6, 2606:4700:10::6816:3de6, 2606:4700:10::ac43:253d
Response IP 172.67.37.61
Found Yes
Hash 9f599360f890816fe610b9059373928a876b13d29eeb787f09b045f60cd12460
SimHash 28011a220f73

Groups

*

Rule Path
Allow /
Disallow /db/*/page/*?sort=
Disallow /embed.js

Other Records

Field Value
sitemap https://nwdb.info/sitemap.txt
sitemap https://nwdb.info/sitemap.xml
sitemap https://nwdb.info/rss.xml