davekobrenski.com
robots.txt
Robots Exclusion Standard data for davekobrenski.com
Resource Scan
Scan Details
Site Domain | davekobrenski.com |
Base Domain | davekobrenski.com |
Scan Status | Ok |
Last Scan | 2025-09-02T14:50:53+00:00 |
Next Scan | 2025-10-02T14:50:53+00:00 |
Last Scan
Scanned | 2025-09-02T14:50:53+00:00 |
URL | https://davekobrenski.com/robots.txt |
Domain IPs | 104.21.1.64, 172.67.128.187, 2606:4700:3032::ac43:80bb, 2606:4700:3037::6815:140 |
Response IP | 172.67.128.187 |
Found | Yes |
Hash | 564b880a924254cf9310dd4cdee41efaf38cdd97e9151474ba443e50d61ebf6f |
SimHash | ac0d1c65c6d8 |
Groups
*
Rule | Path |
---|---|
Disallow | /anki/ |
Disallow | /cgi-bin/ |
Disallow | /davekobrenski/ |
Disallow | /e/ |
Disallow | /enfant-noir/ |
Disallow | /gallery-test/ |
Disallow | /kissycat/ |
Disallow | /mail-images/ |
Disallow | /petitprince/ |
Disallow | /saatchi.php/ |
Disallow | /saatchiraw.html/ |
Disallow | /tmp/ |
Disallow | /u/ |
Disallow | /ynab/ |
Other Records
Field | Value |
---|---|
sitemap | https://davekobrenski.com/sitemap.xml |