susangilbert.com
robots.txt
Robots Exclusion Standard data for susangilbert.com
Resource Scan
Scan Details
| Site Domain | susangilbert.com |
| Base Domain | susangilbert.com |
| Scan Status | Ok |
| Last Scan | 3/30/2025, 6:29:59 AM |
| Next Scan | 4/29/2025, 6:29:59 AM |
Last Scan
| Scanned | 3/30/2025, 6:29:59 AM |
| URL | https://susangilbert.com/robots.txt |
| Domain IPs | 162.241.218.166 |
| Response IP | 162.241.218.166 |
| Found | Yes |
| Hash | d1ab42b052df766ceb635bb2ab5d6030b7be2b0131aa9fd6cb2df215f75d96a6 |
| SimHash | a163eb08c7e1 |
Groups
*
| Rule | Path | Comment |
|---|---|---|
| Disallow | /images/ | - |
| Disallow | /uploads/ | - |
| Disallow | /socialmedia/smkit.html | - |
| Disallow | socialmedia/smkit.html | - |
| Disallow | /tmp/ | - |
| Disallow | /proposal/ | Block the /proposal/directory. |
| Disallow | Block pdf files. Non-standard but works for major search engines. |
Warnings
- 1 invalid line.