jennyscrapokort.blogg.se
robots.txt
Robots Exclusion Standard data for jennyscrapokort.blogg.se
Resource Scan
Scan Details
Site Domain | jennyscrapokort.blogg.se |
Base Domain | blogg.se |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-09-22T14:02:52+00:00 |
Next Scan | 2024-09-29T14:02:52+00:00 |
Last Successful Scan
Scanned | 2023-10-28T13:24:17+00:00 |
URL | https://jennyscrapokort.blogg.se/robots.txt |
Domain IPs | 104.26.8.90, 104.26.9.90, 172.67.73.105, 2606:4700:20::681a:85a, 2606:4700:20::681a:95a, 2606:4700:20::ac43:4969 |
Response IP | 104.26.8.90 |
Found | Yes |
Hash | 542799ebfca6d740913f1e36fbd085e55e716a08a5174b862bc4669531e6779b |
SimHash | 035489c12753 |
Other Records
Field | Value |
---|---|
sitemap | http://jennyscrapokort.blogg.se/sitemap.xml |
Comments