le-francais.ru
robots.txt
Robots Exclusion Standard data for le-francais.ru
Resource Scan
Scan Details
Site Domain | le-francais.ru |
Base Domain | le-francais.ru |
Scan Status | Ok |
Last Scan | 2024-11-02T03:22:05+00:00 |
Next Scan | 2024-11-09T03:22:05+00:00 |
Last Scan
Scanned | 2024-11-02T03:22:05+00:00 |
URL | https://www.le-francais.ru/robots.txt |
Domain IPs | 104.21.11.211, 172.67.192.166, 2606:4700:3031::ac43:c0a6, 2606:4700:3033::6815:bd3 |
Response IP | 104.21.11.211 |
Found | Yes |
Hash | 129fddcbf66e46a5848c765cc52683b9aeb371ad5cc0250f78b24f6ef62ae0be |
SimHash | 47496e64edb1 |
Groups
*
Rule | Path |
---|---|
Disallow | /lecons/bibliotheque/resumes/ |
Disallow | /lecons/futur/ |
Disallow | /old_site/ |
Disallow | /accounts/ |
Disallow | /forum/post/ |
Disallow | /forum/users/ |
Disallow | /comments |
Disallow | /conjugation/ |
Disallow | /payments/ |
Disallow | /conjugaison/polly/ |
Disallow | /conjugaison/verbs_autocomplete/ |
Disallow | /home/lesson-transcript-prototype/ |
Disallow | /static/components/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.le-francais.ru/sitemap.xml |
Warnings
- `host` is not a known field.