ar.pikbest.com
robots.txt
Robots Exclusion Standard data for ar.pikbest.com
Resource Scan
Scan Details
| Site Domain | ar.pikbest.com |
| Base Domain | pikbest.com |
| Scan Status | Ok |
| Last Scan | 2025-03-03T09:00:32+00:00 |
| Next Scan | 2025-04-02T09:00:32+00:00 |
Last Scan
| Scanned | 2025-03-03T09:00:32+00:00 |
| URL | https://ar.pikbest.com/robots.txt |
| Domain IPs | 104.18.26.9, 104.18.27.9 |
| Response IP | 104.18.26.9 |
| Found | Yes |
| Hash | 1331fe53fef672c1ef18456461692571f8e4fe35de6851ab5d027203d0d02feb |
| SimHash | 640452547c33 |
Groups
*
| Rule | Path |
|---|---|
| Allow | /*?page= |
| Allow | /so/*/*-*-0-0-0-0-c0_*-*.html |
| Allow | /*/*?p= |
| Disallow | /*?* |
| Disallow | /vip/ |
| Disallow | /all/ |
| Disallow | /?m=download&id=* |
| Disallow | /*xxx* |
| Disallow | /aggregate/ |
| Disallow | /so/*/*-*-0-0-0-0-*.html |
| Disallow | /so/*/*-*-*-*-*-*-*_*-*.html |
| Disallow | /so/tooth-implant.html |
| Disallow | /so/tooth-paste.html |
| Disallow | /free-*/*_*.html |
| Disallow | /sucai/ |
| Disallow | /amp/free-*/*_*.html |
| Disallow | /cdn-cgi/ |