savef.net
robots.txt
Robots Exclusion Standard data for savef.net
Resource Scan
Scan Details
Site Domain | savef.net |
Base Domain | savef.net |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-04-21T14:57:04+00:00 |
Next Scan | 2024-07-20T14:57:04+00:00 |
Last Successful Scan
Scanned | 2023-03-06T08:38:13+00:00 |
URL | https://savef.net/robots.txt |
Domain IPs | 104.26.12.232, 104.26.13.232, 172.67.71.223, 2606:4700:20::681a:ce8, 2606:4700:20::681a:de8, 2606:4700:20::ac43:47df |
Response IP | 104.26.13.232 |
Found | Yes |
Hash | 17fc3e2cf76a00a6f1e2e2cb57586c671f3218d99af9a89edc39273799254ecd |
SimHash | 48459c51c7f3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /terms-of-use/ |
Disallow | /privacy-policy/ |
Other Records
Field | Value |
---|---|
sitemap | https://savef.net/sitemap.xml |
Warnings
- `host` is not a known field.