q8car.com
robots.txt
Robots Exclusion Standard data for q8car.com
Resource Scan
Scan Details
Site Domain | q8car.com |
Base Domain | q8car.com |
Scan Status | Ok |
Last Scan | 2024-05-28T15:17:10+00:00 |
Next Scan | 2024-06-04T15:17:10+00:00 |
Last Scan
Scanned | 2024-05-28T15:17:10+00:00 |
URL | https://q8car.com/robots.txt |
Redirect | https://www.q8car.com/robots.txt |
Redirect Domain | www.q8car.com |
Redirect Base | q8car.com |
Domain IPs | 104.21.85.224, 172.67.211.195, 2606:4700:3032::6815:55e0, 2606:4700:3037::ac43:d3c3 |
Redirect IPs | 13.226.210.103, 13.226.210.108, 13.226.210.39, 13.226.210.77, 2600:9000:20f0:5e00:19:e1a2:d440:93a1, 2600:9000:20f0:6000:19:e1a2:d440:93a1, 2600:9000:20f0:600:19:e1a2:d440:93a1, 2600:9000:20f0:6400:19:e1a2:d440:93a1, 2600:9000:20f0:7a00:19:e1a2:d440:93a1, 2600:9000:20f0:9000:19:e1a2:d440:93a1, 2600:9000:20f0:9400:19:e1a2:d440:93a1, 2600:9000:20f0:d200:19:e1a2:d440:93a1 |
Response IP | 108.157.60.6 |
Found | Yes |
Hash | b88ceaa7787736ed620d3795befcb8fad67c70e1a23cd27e48cab56612557e0b |
SimHash | 2008a853a6b0 |
Groups
*
Rule | Path |
---|---|
Allow | /ads.txt |
Allow | /app-ads.txt |
Disallow | /resources/ |
Disallow | /sharing/ |
Disallow | /vendor/ |
Disallow | /billingoptions/ |
Disallow | /auth/ |
Disallow | /en/auth/ |
Disallow | /ar/auth/ |
Disallow | /me/* |
Disallow | /en/me/* |
Disallow | /ar/me/* |
Disallow | /api/* |
Disallow | /ar/4sale-ui |
Disallow | /en/4sale-ui |
Other Records
Field | Value |
---|---|
crawl-delay | 1 |