hahasale.com
robots.txt
Robots Exclusion Standard data for hahasale.com
Resource Scan
Scan Details
Site Domain | hahasale.com |
Base Domain | hahasale.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-16T01:27:06+00:00 |
Next Scan | 2024-12-15T01:27:06+00:00 |
Last Successful Scan
Scanned | 2023-10-30T01:24:08+00:00 |
URL | https://hahasale.com/robots.txt |
Domain IPs | 104.21.13.40, 172.67.197.173, 2606:4700:3035::ac43:c5ad, 2606:4700:3036::6815:d28 |
Response IP | 104.21.13.40 |
Found | Yes |
Hash | c7d184e58ad7d70a20ab814a84b263d6f164a5503f428461916009fdfe2a6d04 |
SimHash | cacad5c0e901 |
Groups
*
Rule | Path |
---|---|
Disallow | /nocache/ |
Disallow | /pianren/ |
Disallow | /pianrenmail/ |
Disallow | /forum/ |
Disallow | /forum_x/ |
Disallow | /index.php/base/notify |
Disallow | /index.php/roles/account |
Disallow | /index.php/registration/register |
Disallow | /index.php?module=articles&func=modify&aid=* |
Disallow | /index.php?module=comments&func=display |
Disallow | /index.php?module=comments&func=reply |
Disallow | /index.php?module=roles&func=email |
Disallow | /index.php?module=categories&type=admin |
Disallow | /index.php?module=articles&type=admin |
Disallow | /index.php/articles/map/ |
Disallow | /*Any-of-these-categories |
Disallow | /*sort%3D |
Disallow | /*gclid%3D |
Disallow | /nocache/ |
Disallow | /pianren/ |
Disallow | /pianrenmail/ |
Disallow | /forum/ |
Disallow | /forum_x/ |
Other Records
Field | Value |
---|---|
crawl-delay | 20 |
Warnings
- 2 invalid lines.
Comments