machinio.com
robots.txt
Robots Exclusion Standard data for machinio.com
Resource Scan
Scan Details
Site Domain | machinio.com |
Base Domain | machinio.com |
Scan Status | Failed |
Failure Reason | Scan timed out. |
Last Scan | 2024-09-17T03:02:52+00:00 |
Next Scan | 2024-12-16T03:02:52+00:00 |
Last Successful Scan
Scanned | 2022-11-05T00:24:38+00:00 |
URL | https://machinio.com/robots.txt |
Redirect | https://www.machinio.com/robots.txt |
Redirect Domain | www.machinio.com |
Redirect Base | machinio.com |
Response IP | 35.170.29.171, 3.224.47.3, 54.197.227.86 |
Found | Yes |
Hash | e09f18ca781e09849bf0074f344b74f3d758f4f1b6c2131f8016d681716049e2 |
SimHash | 7b1c8805a9f2 |
Groups
*
Rule | Path |
---|---|
Disallow | /*.json |
*
Rule | Path |
---|---|
Disallow | /collect |
*
Rule | Path |
---|---|
Disallow | /api/v1/amp/listings |
Other Records
Field | Value |
---|---|
sitemap | https://www.machinio.com/sitemaps/sitemap.xml.gz |