spicebazaar.pk
robots.txt
Robots Exclusion Standard data for spicebazaar.pk
Resource Scan
Scan Details
Site Domain | spicebazaar.pk |
Base Domain | spicebazaar.pk |
Scan Status | Ok |
Last Scan | 2025-04-09T21:57:35+00:00 |
Next Scan | 2025-05-09T21:57:35+00:00 |
Last Scan
Scanned | 2025-04-09T21:57:35+00:00 |
URL | https://spicebazaar.pk/robots.txt |
Domain IPs | 104.21.95.126, 172.67.144.244, 2606:4700:3035::6815:5f7e, 2606:4700:3037::ac43:90f4 |
Response IP | 172.67.144.244 |
Found | Yes |
Hash | 16f8908e21a148609941596b8b06b559c40b7ad614f2a5ed666a032bd40ebf1a |
SimHash | 6b04084f85fb |
Groups
*
Rule | Path |
---|---|
Allow | / |
facebookexternalhit
Rule | Path |
---|---|
Allow | / |
Disallow | /website/ajax_cart |
Disallow | /show/wishlist |
Disallow | /place-order |
Disallow | /show/cart |
Disallow | /index.php/website/ajax_cart |
Disallow | /set/time |
Disallow | /index.php/set/time |
Disallow | /website/set_time |
Disallow | /index.php/website/set_time |
Disallow | /website/ajax_homepage_items |
Disallow | /index.php/website/ajax_homepage_items |
Disallow | /website/ajax_main_search |
Disallow | /website/ajax_menu_detail |
Disallow | /website/ajax_cart_view |
Disallow | /website/ga4 |
Disallow | /website/ajax_delivery_charges_by_lat_log |
Disallow | /index.php/website/ajax_main_search |
Disallow | /index.php/website/ajax_menu_detail |
Disallow | /search?cat_filter%5B%5D |
Disallow | /wishlist/remove_wishlist |
Disallow | /wishlist/reset_wishlist |
Disallow | /signup/forgot_password |
Disallow | /website/ajax_update_branch_id |
Disallow | /wishlist/add_wishlist |
Disallow | /website/subscribe_user_by_email |
Disallow | /signup/generateOTP |
Disallow | /search |
Disallow | /wishlist/restore_wishlist |
Disallow | /website/ajax_menu_id |
Disallow | /*?* |
Other Records
Field | Value |
---|---|
sitemap | https://spicebazaar.pk/sitemap.xml |