canonistas.com
robots.txt
Robots Exclusion Standard data for canonistas.com
Resource Scan
Scan Details
Site Domain | canonistas.com |
Base Domain | canonistas.com |
Scan Status | Ok |
Last Scan | 2024-05-27T11:56:41+00:00 |
Next Scan | 2024-06-03T11:56:41+00:00 |
Last Scan
Scanned | 2024-05-27T11:56:41+00:00 |
URL | https://canonistas.com/robots.txt |
Domain IPs | 66.147.238.237 |
Response IP | 66.147.238.237 |
Found | Yes |
Hash | 7a13ed8f98066b18fb4239bf1edfd6717cfd75a122606453d82368cee7dd6e92 |
SimHash | 3d3844605691 |
Groups
*
Rule | Path |
---|---|
Disallow | /404/ |
Disallow | /cuentas/ |
Disallow | /archivos/ |
Disallow | /images/ |
Disallow | /revelado.com/ |
Disallow | /Templates/ |
Disallow | /tmp/ |
Disallow | /foros/include |
Disallow | /foros/install |
Disallow | /foros/comprar/79026-consejos-evitar-estafas-y-estafas-44.html |
Disallow | /foros/comprar/292803-otra-estafa-red-cuidadin-2.html |
Disallow | /foros/comprar/448875-conoces-mytelecom-3.html |
Disallow | /foros/comprar/448875-conoces-mytelecom-2.html |
Disallow | /foros/comprar/448875-conoces-mytelecom-1.html |
Disallow | /foros/comprar/448875-conoces-mytelecom.html |
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 60 |