spinnfiske.net
robots.txt
Robots Exclusion Standard data for spinnfiske.net
Resource Scan
Scan Details
| Site Domain | spinnfiske.net |
| Base Domain | spinnfiske.net |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-12T18:25:47+00:00 |
| Next Scan | 2024-12-11T18:25:47+00:00 |
Last Successful Scan
| Scanned | 2024-07-22T18:24:27+00:00 |
| URL | https://spinnfiske.net/robots.txt |
| Domain IPs | 104.21.95.241, 172.67.149.165, 2606:4700:3031::6815:5ff1, 2606:4700:3037::ac43:95a5 |
| Response IP | 104.21.95.241 |
| Found | Yes |
| Hash | f233b3df1dd35698e991e237d6fabd919063f872099f3dc54d231965ba96b3e3 |
| SimHash | 8c4c8a428971 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /noindex/ |
| Disallow | /ipv.html |
| Disallow | /404.html |
Other Records
| Field | Value |
|---|---|
| sitemap | https://spinnfiske.net/sitemap.xml |