q84sale.com
robots.txt
Robots Exclusion Standard data for q84sale.com
Resource Scan
Scan Details
Site Domain | q84sale.com |
Base Domain | q84sale.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-11-04T09:09:24+00:00 |
Next Scan | 2024-12-04T09:09:24+00:00 |
Last Successful Scan
Scanned | 2024-10-06T05:33:15+00:00 |
URL | https://q84sale.com/robots.txt |
Domain IPs | 18.154.132.103, 18.154.132.110, 18.154.132.39, 18.154.132.63 |
Response IP | 3.164.68.35 |
Found | Yes |
Hash | 2375bca7f28bba033b26205062469d3bdda15d45e13dd612941f5674da940df8 |
SimHash | e202a8537eb0 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
Allow | /app-ads.txt |
Disallow | /scripts/ |
Disallow | /webview/* |
Disallow | /resources/ |
Disallow | /sharing/ |
Disallow | /vendor/ |
Disallow | /billingoptions/ |
Disallow | /me/* |
Disallow | /en/me/* |
Disallow | /ar/me/* |
Disallow | /api/* |
Disallow | /ar/4sale-ui |
Disallow | /en/4sale-ui |
Disallow | /xviews/* |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
Other Records
Field | Value |
---|---|
sitemap | https://www.q84sale.com/sitemap.xml |