buyon.pk
robots.txt
Robots Exclusion Standard data for buyon.pk
Resource Scan
Scan Details
| Site Domain | buyon.pk |
| Base Domain | buyon.pk |
| Scan Status | Ok |
| Last Scan | 2024-10-04T18:24:54+00:00 |
| Next Scan | 2024-11-03T18:24:54+00:00 |
Last Scan
| Scanned | 2024-10-04T18:24:54+00:00 |
| URL | https://buyon.pk/robots.txt |
| Redirect | https://www.buyon.pk/robots.txt |
| Redirect Domain | www.buyon.pk |
| Redirect Base | buyon.pk |
| Domain IPs | 104.21.27.218, 172.67.169.198, 2606:4700:3031::ac43:a9c6, 2606:4700:3036::6815:1bda |
| Redirect IPs | 104.21.27.218, 172.67.169.198, 2606:4700:3031::ac43:a9c6, 2606:4700:3036::6815:1bda |
| Response IP | 104.21.27.218 |
| Found | Yes |
| Hash | 244bae404510807cf7a590402fdcb7edc368e7569ac478bbb41f72963439e6ed |
| SimHash | 0e0d99616f31 |
Groups
baiduspider
yandexbot
blexbot
megaindex.ru
megaindex.com
| Rule | Path |
|---|---|
| Disallow | / |
| Disallow | /dev.buyon.pk/ |
| Disallow | /image |
| Disallow | /beta |
| Disallow | /dev |
| Disallow | /dashboard |
| Disallow | /cgi-bin |
| Disallow | /op-cache |
| Disallow | /checkout-success |
| Disallow | /product-search%26search%3D* |
| Disallow | /*route%3Daccount/ |
| Disallow | /*route%3Daffiliate/ |
| Disallow | /*route%3Dcheckout/ |
| Disallow | /*route%3Dproduct/search |
| Disallow | /index.php?route=product%2Fproduct*&manufacturer_id= |
| Disallow | /admin |
| Disallow | /catalog |
| Disallow | /download |
| Disallow | /export |
| Disallow | /system |
| Disallow | /*?sort= |
| Disallow | /*%26sort%3D |
| Disallow | /*?order= |
| Disallow | /*%26order%3D |
| Disallow | /*?limit= |
| Disallow | /*%26limit%3D |
| Disallow | /*?filter_name= |
| Disallow | /*%26filter_name%3D |
| Disallow | /*?filter_sub_category= |
| Disallow | /*%26filter_sub_category%3D |
| Disallow | /*?filter_description= |
| Disallow | /*%26filter_description%3D |
| Disallow | /*?tracking= |
| Disallow | /*%26tracking%3D |
| Disallow | /*?page= |
| Disallow | /*%26page%3D |
| Disallow | /wishlist |
| Disallow | /login |
| Disallow | /index.php?route=product%2Fmanufacturer |
| Disallow | /index.php?route=product%2Fcompare |
| Disallow | /index.php?route=product%2Fcategory |
*
| Rule | Path |
|---|---|
| Allow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.buyon.pk/sitemap.xml |
Comments