clothoff.io
robots.txt
Robots Exclusion Standard data for clothoff.io
Resource Scan
Scan Details
| Site Domain | clothoff.io |
| Base Domain | clothoff.io |
| Scan Status | Ok |
| Last Scan | 2024-04-03T09:31:49+00:00 |
| Next Scan | 2024-05-03T09:31:49+00:00 |
Last Scan
| Scanned | 2024-04-03T09:31:49+00:00 |
| URL | https://clothoff.io/robots.txt |
| Domain IPs | 104.26.12.180, 104.26.13.180, 172.67.69.7, 2606:4700:20::681a:cb4, 2606:4700:20::681a:db4, 2606:4700:20::ac43:4507 |
| Response IP | 104.26.12.180 |
| Found | Yes |
| Hash | b2e108c9b307ac051faaed3aa8fdb94193dbaa3df2de15187f20e0691cd66d6a |
| SimHash | 9088ec6a69b1 |
Groups
google
| Rule | Path |
|---|---|
| Allow | /ru |
| Disallow | /api |
| Disallow | /r%3D* |
| Disallow | /r |
| Disallow | /p%3D* |
| Disallow | /cdn-cgi |
| Disallow | /buy |
| Disallow | /earn |
| Disallow | /free |
| Disallow | /make_money |
| Disallow | /subscribe/offer |
| Disallow | /tutor |
| Disallow | /activate-promocode |
| Disallow | /attach-photo-by-url |
| Disallow | /get-notify |
| Disallow | /tutor-anime |
| Disallow | /tutor-hd |
| Disallow | /tg_bot |
| Disallow | /change-lang |
yandex
| Rule | Path |
|---|---|
| Allow | /ru |
| Disallow | /api |
| Disallow | /r%3D* |
| Disallow | /r |
| Disallow | /p%3D* |
| Disallow | /cdn-cgi |
| Disallow | /buy |
| Disallow | /earn |
| Disallow | /free |
| Disallow | /make_money |
| Disallow | /subscribe/offer |
| Disallow | /tutor |
| Disallow | /activate-promocode |
| Disallow | /attach-photo-by-url |
| Disallow | /get-notify |
| Disallow | /tutor-anime |
| Disallow | /tutor-hd |
| Disallow | /tg_bot |
| Disallow | /change-lang |
*
| Rule | Path |
|---|---|
| Allow | /ru |
| Disallow | /api |
| Disallow | /r%3D* |
| Disallow | /r |
| Disallow | /p%3D* |
| Disallow | /cdn-cgi |
| Disallow | /buy |
| Disallow | /earn |
| Disallow | /free |
| Disallow | /make_money |
| Disallow | /subscribe/offer |
| Disallow | /tutor |
| Disallow | /activate-promocode |
| Disallow | /attach-photo-by-url |
| Disallow | /get-notify |
| Disallow | /tutor-anime |
| Disallow | /tutor-hd |
| Disallow | /tg_bot |
| Disallow | /change-lang |
Other Records
| Field | Value |
|---|---|
| sitemap | https://clothoff.io/sitemap.xml |
Warnings
- `host` is not a known field.