cheapcar.my
robots.txt
Robots Exclusion Standard data for cheapcar.my
Resource Scan
Scan Details
Site Domain | cheapcar.my |
Base Domain | cheapcar.my |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Couldn't connect to server. |
Last Scan | 2024-10-02T14:35:37+00:00 |
Next Scan | 2024-12-31T14:35:37+00:00 |
Last Successful Scan
Scanned | 2023-06-04T00:46:13+00:00 |
URL | https://cheapcar.my/robots.txt |
Domain IPs | 104.21.6.71, 172.67.134.150, 2606:4700:3031::6815:647, 2606:4700:3033::ac43:8696 |
Response IP | 172.67.134.150 |
Found | Yes |
Hash | c7d184e58ad7d70a20ab814a84b263d6f164a5503f428461916009fdfe2a6d04 |
SimHash | cacad5c0e901 |
Groups
*
Rule | Path |
---|---|
Disallow | /nocache/ |
Disallow | /pianren/ |
Disallow | /pianrenmail/ |
Disallow | /forum/ |
Disallow | /forum_x/ |
Disallow | /index.php/base/notify |
Disallow | /index.php/roles/account |
Disallow | /index.php/registration/register |
Disallow | /index.php?module=articles&func=modify&aid=* |
Disallow | /index.php?module=comments&func=display |
Disallow | /index.php?module=comments&func=reply |
Disallow | /index.php?module=roles&func=email |
Disallow | /index.php?module=categories&type=admin |
Disallow | /index.php?module=articles&type=admin |
Disallow | /index.php/articles/map/ |
Disallow | /*Any-of-these-categories |
Disallow | /*sort%3D |
Disallow | /*gclid%3D |
Disallow | /nocache/ |
Disallow | /pianren/ |
Disallow | /pianrenmail/ |
Disallow | /forum/ |
Disallow | /forum_x/ |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Warnings
- 2 invalid lines.
Comments