buhochile.com
robots.txt
Robots Exclusion Standard data for buhochile.com
Resource Scan
Scan Details
| Site Domain | buhochile.com |
| Base Domain | buhochile.com |
| Scan Status | Ok |
| Last Scan | 2024-11-03T11:51:55+00:00 |
| Next Scan | 2024-12-03T11:51:55+00:00 |
Last Scan
| Scanned | 2024-11-03T11:51:55+00:00 |
| URL | https://buhochile.com/robots.txt |
| Redirect | https://www.buhochile.com/robots.txt |
| Redirect Domain | www.buhochile.com |
| Redirect Base | buhochile.com |
| Domain IPs | 76.76.21.21 |
| Redirect IPs | 76.76.21.142, 76.76.21.93 |
| Response IP | 76.76.21.22 |
| Found | Yes |
| Hash | ccb74535e7ba99486a76bd8371f1bc58d3c55616a1fcaae074d63468398232e1 |
| SimHash | 51005151c6b0 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /order |
| Disallow | /403 |
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /loading-sign-in |
| Disallow | /api |
| Disallow | /pages/order |
| Disallow | /pages/403 |
| Disallow | /pages/404 |
| Disallow | /pages/500 |
| Disallow | /pages/loading-sign-in |
| Disallow | /pages/api |
| Disallow | /_next/image |
amazonbot
anthropic-ai
applebot-extended
bytespider
ccbot
chatgpt-user
claudebot
claude-web
cohere-ai
diffbot
facebookbot
friendlycrawler
facebookexternalhit
gptbot
imagesiftbot
img2dataset
meta-externalagent
oai-searchbot
omgili
omgilibot
perplexitybot
petalbot
scrapy
timpibot
velenpublicwebcrawler
youbot
| Rule | Path |
|---|---|
| Disallow | / |