nocknock.co
robots.txt

Robots Exclusion Standard data for nocknock.co

Resource Scan

Scan Details

Site Domain nocknock.co
Base Domain nocknock.co
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-06T14:12:30+00:00
Next Scan 2024-07-05T14:12:30+00:00

Last Successful Scan

Scanned2023-06-02T15:18:14+00:00
URL https://nocknock.co/robots.txt
Redirect https://www.nocknock.co/robots.txt
Redirect Domain www.nocknock.co
Redirect Base nocknock.co
Domain IPs 76.76.21.21
Redirect IPs 76.76.21.61, 76.76.21.98
Response IP 76.76.21.241
Found Yes
Hash d6f425a7de80a13ee003c6a16019d3c7eb07dafbee28592d1488c57b0577815f
SimHash d470cac2a556

Groups

*

Rule Path
Disallow /account

*

Rule Path
Disallow /mobile

*

Rule Path
Disallow /start

*

Rule Path
Allow /

Comments

  • https://www.robotstxt.org/robotstxt.html
  • Block all crawlers for private or native mobile specific app pages
  • Block all crawlers for landing pages
  • Allow all crawlers