ipshopy.com
robots.txt

Robots Exclusion Standard data for ipshopy.com

Resource Scan

Scan Details

Site Domain ipshopy.com
Base Domain ipshopy.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-10T02:19:22+00:00
Next Scan 2025-12-10T02:19:22+00:00

Last Successful Scan

Scanned2025-10-11T02:02:16+00:00
URL https://ipshopy.com/robots.txt
Redirect https://www.ipshopy.com/robots.txt
Redirect Domain www.ipshopy.com
Redirect Base ipshopy.com
Domain IPs 104.26.8.195, 104.26.9.195, 172.67.72.121, 2606:4700:20::681a:8c3, 2606:4700:20::681a:9c3, 2606:4700:20::ac43:4879
Redirect IPs 104.26.8.195, 104.26.9.195, 172.67.72.121, 2606:4700:20::681a:8c3, 2606:4700:20::681a:9c3, 2606:4700:20::ac43:4879
Response IP 172.67.72.121
Found Yes
Hash 521fb62289ee3505ddc9115e4ecbce48e48f997f396cc950b098ea24bebdaec2
SimHash c10e68b2e989

Groups

*

Rule Path
Disallow /admin/
Disallow /system/
Disallow /catalog/view/
Disallow /private/
Disallow /includes/
Disallow /config/
Disallow /download/
Disallow /install/
Disallow /logs/
Disallow /cache/
Disallow /checkout/
Disallow /cart/
Disallow /account/
Disallow /search/
Disallow /compare/
Disallow /wishlist/
Disallow /vendor/
Disallow /image/cache/
Disallow /image/data/
Disallow /*sort%3D
Disallow /*filter%3D
Disallow /*page%3D
Disallow /*limit%3D
Disallow /*route%3Daccount/
Disallow /*route%3Dcheckout/
Disallow /*route%3Dproduct/search
Disallow /*route%3Daffiliate/
Disallow /route%3Derror
Disallow /*route%3Dinformation/contact
Disallow /*utm_source%3D
Disallow /*utm_campaign%3D
Disallow /*utm_medium%3D
Disallow /*order%3D
Disallow /*tag%3D
Disallow /*manufacturer_id%3D
Disallow /*product_id%3D
Disallow /*search%3D
Disallow /*review%3D
Disallow /*quickview%3D
Allow /product/
Allow /category/
Allow /content/
Allow /blog/
Allow /image/catalog/

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

googlebot

Rule Path
Allow /product/
Allow /category/
Allow /blog/
Disallow /checkout/
Disallow /account/

Other Records

Field Value
sitemap https://www.ipshopy.com/sitemap.xml

Comments

  • Disallow specific parameters to prevent duplicate content and indexing
  • New additions for preventing tracking parameters from being indexed
  • Allow crawling of valuable content
  • Block known spam bots
  • Googlebot rules (inherits global + extras)
  • Sitemap