bouden.pe
robots.txt

Robots Exclusion Standard data for bouden.pe

Resource Scan

Scan Details

Site Domain bouden.pe
Base Domain bouden.pe
Scan Status Ok
Last Scan2024-05-18T07:45:56+00:00
Next Scan 2024-06-17T07:45:56+00:00

Last Scan

Scanned2024-05-18T07:45:56+00:00
URL https://www.bouden.pe/robots.txt
Domain IPs 108.156.133.102, 108.156.133.127, 108.156.133.85, 108.156.133.88, 2600:9000:2755:1800:14:40e1:9980:93a1, 2600:9000:2755:2e00:14:40e1:9980:93a1, 2600:9000:2755:5000:14:40e1:9980:93a1, 2600:9000:2755:ae00:14:40e1:9980:93a1, 2600:9000:2755:b800:14:40e1:9980:93a1, 2600:9000:2755:e00:14:40e1:9980:93a1, 2600:9000:2755:e800:14:40e1:9980:93a1, 2600:9000:2755:f800:14:40e1:9980:93a1
Response IP 108.156.133.127
Found Yes
Hash 2ee22d9d9c72447e271adcfcc3c8c6e4ac22f15c33425b3519a62936029c03be
SimHash 8855af223ce5

Groups

*

Rule Path
Disallow /*account
Disallow /*login
Disallow /*checkout
Disallow /*busca
Disallow /quick-view/*
Disallow /espiar/*
Disallow /*buscapagina
Disallow /*?O=OrderByReleaseDateDESC&PS=48
Disallow /*specificationFilter
Allow /NinjaBot/
Allow /GoogleBot/
Allow /GoogleBot-Mobile/
Allow /GoogleBot-Image/
Allow /Mediapartners-Google/
Allow /Adsbot-Google/
Allow /Bingbot/
Allow /Slurp/
Allow /Teoma/
Allow /twiceler/

Other Records

Field Value
sitemap https://www.bouden.pe/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.