yalwa.cl
robots.txt
Robots Exclusion Standard data for yalwa.cl
Resource Scan
Scan Details
Site Domain | yalwa.cl |
Base Domain | yalwa.cl |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2025-05-20T16:06:14+00:00 |
Next Scan | 2025-08-18T16:06:14+00:00 |
Last Successful Scan
Scanned | 2022-11-12T01:28:15+00:00 |
URL | https://yalwa.cl/robots.txt |
Response IP | 104.18.10.238, 104.18.11.238 |
Found | Yes |
Hash | ae870f782a93e25ec24e26ec346561ea1f7201fdf451c52eb2598ad84364af60 |
SimHash | 6b9a43f3cfe3 |
Groups
*
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /*index.rss$ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
msnbot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /api/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
bingbot
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /api/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /*index.rss$ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
slurp
Rule | Path |
---|---|
Disallow | /cgi-bin/ |
Disallow | /asclick/ |
Disallow | /post_G1/ |
Disallow | /register_G2/ |
Disallow | /afs_click/ |
Disallow | /api/ |
Disallow | /run/faq/ |
Disallow | /m/run/faq/ |
Disallow | /my/ |
Disallow | /m/my/ |
Disallow | /*index.rss$ |
Disallow | /images/sprites/ |
Disallow | /images/bg/ |
Disallow | /images/16/ |
Disallow | /images/32/ |
Disallow | /images/48/ |
Disallow | /images/64/ |
Disallow | /images/100/ |
Disallow | /images/128/ |
Disallow | /images/256/ |
Disallow | /images/share/ |
Disallow | /manage/ |
Disallow | /*/manage/ |
Other Records
Field | Value |
---|---|
crawl-delay | 60 |
Warnings
- 2 invalid lines.
Comments