robertkaufman.com
robots.txt

Robots Exclusion Standard data for robertkaufman.com

Resource Scan

Scan Details

Site Domain robertkaufman.com
Base Domain robertkaufman.com
Scan Status Ok
Last Scan2024-05-13T10:17:40+00:00
Next Scan 2024-06-12T10:17:40+00:00

Last Scan

Scanned2024-05-13T10:17:40+00:00
URL https://robertkaufman.com/robots.txt
Redirect https://www.robertkaufman.com/robots.txt
Redirect Domain www.robertkaufman.com
Redirect Base robertkaufman.com
Domain IPs 192.124.249.61
Redirect IPs 192.124.249.61
Response IP 192.124.249.61
Found Yes
Hash c17d2f2b3304c6cfc1e5b3856a158df0c6fa761ee35e8d8156b8baacd24467c0
SimHash c158de2247f0

Groups

*

Rule Path
Disallow

paperlibot

Rule Path
Disallow /
Disallow /

Warnings

  • 1 invalid line.
  • `host` is not a known field.