bouden.pe
robots.txt
Robots Exclusion Standard data for bouden.pe
Resource Scan
Scan Details
Site Domain | bouden.pe |
Base Domain | bouden.pe |
Scan Status | Ok |
Last Scan | 2024-05-18T07:45:56+00:00 |
Next Scan | 2024-06-17T07:45:56+00:00 |
Last Scan
Scanned | 2024-05-18T07:45:56+00:00 |
URL | https://www.bouden.pe/robots.txt |
Domain IPs | 108.156.133.102, 108.156.133.127, 108.156.133.85, 108.156.133.88, 2600:9000:2755:1800:14:40e1:9980:93a1, 2600:9000:2755:2e00:14:40e1:9980:93a1, 2600:9000:2755:5000:14:40e1:9980:93a1, 2600:9000:2755:ae00:14:40e1:9980:93a1, 2600:9000:2755:b800:14:40e1:9980:93a1, 2600:9000:2755:e00:14:40e1:9980:93a1, 2600:9000:2755:e800:14:40e1:9980:93a1, 2600:9000:2755:f800:14:40e1:9980:93a1 |
Response IP | 108.156.133.127 |
Found | Yes |
Hash | 2ee22d9d9c72447e271adcfcc3c8c6e4ac22f15c33425b3519a62936029c03be |
SimHash | 8855af223ce5 |
Groups
*
Rule | Path |
---|---|
Disallow | /*account |
Disallow | /*login |
Disallow | /*checkout |
Disallow | /*busca |
Disallow | /quick-view/* |
Disallow | /espiar/* |
Disallow | /*buscapagina |
Disallow | /*?O=OrderByReleaseDateDESC&PS=48 |
Disallow | /*specificationFilter |
Allow | /NinjaBot/ |
Allow | /GoogleBot/ |
Allow | /GoogleBot-Mobile/ |
Allow | /GoogleBot-Image/ |
Allow | /Mediapartners-Google/ |
Allow | /Adsbot-Google/ |
Allow | /Bingbot/ |
Allow | /Slurp/ |
Allow | /Teoma/ |
Allow | /twiceler/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.bouden.pe/sitemap.xml |
Comments