hackernoon.com
robots.txt

Robots Exclusion Standard data for hackernoon.com

Resource Scan

Scan Details

Site Domain hackernoon.com
Base Domain hackernoon.com
Scan Status Ok
Last Scan2024-09-15T19:41:26+00:00
Next Scan 2024-09-22T19:41:26+00:00

Last Scan

Scanned2024-09-15T19:41:26+00:00
URL https://hackernoon.com/robots.txt
Domain IPs 104.26.10.89, 104.26.11.89, 172.67.69.96, 2606:4700:20::681a:a59, 2606:4700:20::681a:b59, 2606:4700:20::ac43:4560
Response IP 172.67.69.96
Found Yes
Hash d145ada90b86116a3a901381bf9a8a6912ddc83ab659036446701dd0c68dad45
SimHash 62008143cbb3

Groups

*

Rule Path
Allow /*
Disallow /api/*

Other Records

Field Value
sitemap https://hackernoon.com/sitemap.xml
sitemap https://hackernoon.com/startups/sitemap.xml