fwhaus.ru
robots.txt
Robots Exclusion Standard data for fwhaus.ru
Resource Scan
Scan Details
| Site Domain | fwhaus.ru |
| Base Domain | fwhaus.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-15T05:39:57+00:00 |
| Next Scan | 2024-06-14T05:39:57+00:00 |
Last Scan
| Scanned | 2024-05-15T05:39:57+00:00 |
| URL | http://fwhaus.ru/robots.txt |
| Domain IPs | 31.28.24.125 |
| Response IP | 31.28.24.125 |
| Found | Yes |
| Hash | 9601442d6fec125942bcfdbb35d4645a7945de8681c1b6845990e927e3a674af |
| SimHash | 252adc468313 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /sc-pic/ |
| Disallow | /Fachwerk_forum/ |
| Disallow | /Gallery/sc-pic |
| Disallow | /Gallery/*.jpg |
| Disallow | /Gallery/video/ |
| Disallow | /GFiles/ |
| Disallow | Stroitel_stvo.htm |
| Disallow | Fachwerk_Reklama.htm |
| Disallow | Fachwerk_soedinenija.htm |
| Disallow | Fachwerk_SELwerk.htm |
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 100 |
Warnings
- `аllow` is not a known field.