Log In Sign Up

davidlyness.com
robots.txt

Robots Exclusion Standard data for davidlyness.com

Resource Scan

Scan Details

Site Domain davidlyness.com
Base Domain davidlyness.com
Scan Status Ok
Last Scan2024-05-02T12:45:02+00:00
Next Scan 2024-06-01T12:45:02+00:00

Last Scan

Scanned2024-05-02T12:45:02+00:00
URL https://davidlyness.com/robots.txt
Redirect https://blog.davidlyness.com/robots.txt
Redirect Domain blog.davidlyness.com
Redirect Base davidlyness.com
Domain IPs 104.21.34.107, 172.67.159.66, 2606:4700:3031::6815:226b, 2606:4700:3032::ac43:9f42
Redirect IPs 104.21.34.107, 172.67.159.66, 2606:4700:3031::6815:226b, 2606:4700:3032::ac43:9f42
Response IP 172.67.159.66
Found Yes
Hash 92dba231e4a94208d2be1fe8ed69014ed6744db4a971e378f62adfa1813edfc1
SimHash c617bd256750

Groups

ia_archiver

Rule Path
Disallow /

gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://blog.davidlyness.com/sitemap.xml
Back to top

Comments

  • 1) A robot may not injure a human being or, through inaction, allow a human being to come to harm.
  • 2) A robot must obey any orders given to it by human beings, except where such orders would conflict with the First Law.
  • 3) A robot must protect its own existence as long as such protection does not conflict with the First or Second Law.
Back to top