spocket.co
robots.txt
Robots Exclusion Standard data for spocket.co
Resource Scan
Scan Details
Site Domain | spocket.co |
Base Domain | spocket.co |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-05-20T14:43:34+00:00 |
Next Scan | 2024-08-18T14:43:34+00:00 |
Last Successful Scan
Scanned | 2023-04-04T09:44:58+00:00 |
URL | https://spocket.co/robots.txt |
Redirect | https://www.spocket.co/robots.txt |
Redirect Domain | www.spocket.co |
Redirect Base | spocket.co |
Domain IPs | 34.193.204.92, 34.193.69.252 |
Redirect IPs | 13.115.182.240, 13.115.92.205, 35.79.138.241 |
Response IP | 13.115.182.240 |
Found | Yes |
Hash | c2c9550fcfce011958cae73500f0aa9ae38daf4201120eed65563e6603585ad1 |
SimHash | e70d55ccec99 |
Groups
*
Rule | Path |
---|---|
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /*/blogs/*%2B* |
Disallow | /search |
Disallow | /*/?* |
Disallow | /*?* |
Disallow | /*?utm_source=* |
Disallow | /*?gspk=* |
Disallow | /*?source=* |
Disallow | /*?ref=* |
Other Records
Field | Value |
---|---|
sitemap | https://www.spocket.co/sitemap.xml |