nrdx.com
robots.txt

Robots Exclusion Standard data for nrdx.com

Resource Scan

Scan Details

Site Domain nrdx.com
Base Domain nrdx.com
Scan Status Ok
Last Scan2025-12-22T22:53:12+00:00
Next Scan 2026-01-21T22:53:12+00:00

Last Scan

Scanned2025-12-22T22:53:12+00:00
URL https://nrdx.com/robots.txt
Redirect https://www.nrdx.com/robots.txt
Redirect Domain www.nrdx.com
Redirect Base nrdx.com
Domain IPs 104.26.8.97, 104.26.9.97, 172.67.70.215, 2606:4700:20::681a:861, 2606:4700:20::681a:961, 2606:4700:20::ac43:46d7
Redirect IPs 104.26.8.97, 104.26.9.97, 172.67.70.215, 2606:4700:20::681a:861, 2606:4700:20::681a:961, 2606:4700:20::ac43:46d7
Response IP 104.26.8.97
Found Yes
Hash 4ca70256038f7de62b7cf2f9e43c1cef23a922d99a47afde581f91b37c3c9c5a
SimHash 6810dc924783

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

Other Records

Field Value
crawl-delay 10

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

msnbot

Rule Path
Allow /

slurp

Rule Path
Allow /

teoma

Rule Path
Allow /

gigabot

Rule Path
Allow /

robozilla

Rule Path
Allow /

nutch

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

baiduspider

Rule Path
Allow /

naverbot

Rule Path
Allow /

yeti

Rule Path
Allow /

yahoo-mmcrawler

Rule Path
Allow /

psbot

Rule Path
Allow /

yahoo-blogs/v3.9

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.nrdx.com/sitemap_index.xml