nerd.com
robots.txt

Robots Exclusion Standard data for nerd.com

Resource Scan

Scan Details

Site Domain nerd.com
Base Domain nerd.com
Scan Status Ok
Last Scan2025-08-30T23:52:52+00:00
Next Scan 2025-09-29T23:52:52+00:00

Last Scan

Scanned2025-08-30T23:52:52+00:00
URL https://nerd.com/robots.txt
Redirect https://www.nerd.com/robots.txt
Redirect Domain www.nerd.com
Redirect Base nerd.com
Domain IPs 104.21.14.111, 172.67.158.170, 2606:4700:3031::ac43:9eaa, 2606:4700:3037::6815:e6f
Redirect IPs 104.21.14.111, 172.67.158.170, 2606:4700:3031::ac43:9eaa, 2606:4700:3037::6815:e6f
Response IP 104.21.14.111
Found Yes
Hash ae12c0991cb6d9c3540492c3ac22540a53938c6778c66973195910fba66404cd
SimHash 41404d6d8d92

Groups

*

Rule Path
Allow /css/*
Allow /fonts/*
Allow /img/*
Allow /js/*
Disallow /e/

Other Records

Field Value
sitemap https://www.nerd.com/sitemaps/index.xml