q8car.com
robots.txt
Robots Exclusion Standard data for q8car.com
Resource Scan
Scan Details
Site Domain | q8car.com |
Base Domain | q8car.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-10-30T23:00:38+00:00 |
Next Scan | 2024-11-29T23:00:38+00:00 |
Last Successful Scan
Scanned | 2024-10-01T22:35:17+00:00 |
URL | https://q8car.com/robots.txt |
Redirect | https://www.q8car.com/robots.txt |
Redirect Domain | www.q8car.com |
Redirect Base | q8car.com |
Domain IPs | 104.21.85.224, 172.67.211.195, 2606:4700:3032::6815:55e0, 2606:4700:3037::ac43:d3c3 |
Redirect IPs | 2600:9000:2175:2000:19:e1a2:d440:93a1, 2600:9000:2175:4000:19:e1a2:d440:93a1, 2600:9000:2175:4e00:19:e1a2:d440:93a1, 2600:9000:2175:8600:19:e1a2:d440:93a1, 2600:9000:2175:ce00:19:e1a2:d440:93a1, 2600:9000:2175:e400:19:e1a2:d440:93a1, 2600:9000:2175:f200:19:e1a2:d440:93a1, 2600:9000:2175:fc00:19:e1a2:d440:93a1, 65.9.112.111, 65.9.112.15, 65.9.112.43, 65.9.112.57 |
Response IP | 108.156.22.38 |
Found | Yes |
Hash | b88ceaa7787736ed620d3795befcb8fad67c70e1a23cd27e48cab56612557e0b |
SimHash | 2008a853a6b0 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
Allow | /app-ads.txt |
Disallow | /resources/ |
Disallow | /sharing/ |
Disallow | /vendor/ |
Disallow | /billingoptions/ |
Disallow | /auth/ |
Disallow | /en/auth/ |
Disallow | /ar/auth/ |
Disallow | /me/* |
Disallow | /en/me/* |
Disallow | /ar/me/* |
Disallow | /api/* |
Disallow | /ar/4sale-ui |
Disallow | /en/4sale-ui |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |