comerciolivre.com
robots.txt

Robots Exclusion Standard data for comerciolivre.com

Resource Scan

Scan Details

Site Domain comerciolivre.com
Base Domain comerciolivre.com
Scan Status Ok
Last Scan2024-09-21T12:20:02+00:00
Next Scan 2024-10-21T12:20:02+00:00

Last Scan

Scanned2024-09-21T12:20:02+00:00
URL https://comerciolivre.com/robots.txt
Domain IPs 108.156.133.5, 108.156.133.52, 108.156.133.60, 108.156.133.88
Response IP 108.156.133.5
Found Yes
Hash b3ddab65ad4b8aed701b0a0ca3ba54fc7e23719f43fe52a445b974d57aa30433
SimHash fce4ce1c5fd8

Groups

*

Rule Path
Disallow /addresses
Disallow /auth
Disallow /compras
Disallow /contestations
Disallow /credit
Disallow /product/create/*
Disallow /product/edit/*
Disallow /product/view/*
Disallow /property/create/*
Disallow /property/edit/*
Disallow /property/view/*
Disallow /service/create/*
Disallow /service/edit/*
Disallow /service/view/*
Disallow /user
Disallow /vehicle/create/*
Disallow /vehicle/edit/*
Disallow /vehicle/view/*
Disallow /vendas
Disallow /checkout

*

Rule Path
Allow /
Allow /categorias
Allow /products
Allow /questions/*
Allow /search
Allow /vehicle
Allow /forbidden
Allow /policy
Allow /pricing
Allow /terms-of-service
Allow /work-with-us

Comments

  • Block all crawlers for /accounts
  • Allow all crawlers