lagostina.ca
robots.txt

Robots Exclusion Standard data for lagostina.ca

Resource Scan

Scan Details

Site Domain lagostina.ca
Base Domain lagostina.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-23T20:18:56+00:00
Next Scan 2025-04-06T20:18:56+00:00

Last Successful Scan

Scanned2025-02-13T20:18:12+00:00
URL https://lagostina.ca/robots.txt
Redirect https://www.lagostina.ca/robots.txt
Redirect Domain www.lagostina.ca
Redirect Base lagostina.ca
Domain IPs 152.89.172.56, 2a01:c8:100::54, 2a01:c8:101::55, 2a09:35c0:102::56, 81.92.94.54, 81.92.95.55
Redirect IPs 151.101.1.124, 151.101.129.124, 151.101.193.124, 151.101.65.124
Response IP 199.232.45.124
Found Yes
Hash 92ceb4539e52a9449c300458b25672bd14f7894e406b52e19aa0598289d5e20b
SimHash e105df72c093

Groups

*

Rule Path
Disallow /catalogsearch/*
Disallow /catalog/product_compare/*
Disallow /catalog/category/view/*
Disallow /catalog/product/view/*
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/*
Disallow /public_html/Downloads/*
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?material=
Disallow /*?price=
Disallow /*?p=
Disallow /*?size=
Disallow /*?cat=

mediapartners-google

Rule Path
Allow /

storebot-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

google-inspectiontool

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.lagostina.ca/media/sitemap.xml
sitemap https://www.lagostina.ca/media/sitemap_fr.xml

Comments

  • Disallow Magento System Folders
  • Disallow URL Filter Searches
  • Google's Adsense
  • Google's Storebot
  • Google's Adbot
  • Google's Inspection Tool
  • Google's Image Crawler