bg-homes.ru
robots.txt
Robots Exclusion Standard data for bg-homes.ru
Resource Scan
Scan Details
| Site Domain | bg-homes.ru |
| Base Domain | bg-homes.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 4/5/2025, 3:41:40 AM |
| Next Scan | 7/4/2025, 3:41:40 AM |
Last Successful Scan
| Scanned | 8/16/2024, 3:38:38 AM |
| URL | https://bg-homes.ru/robots.txt |
| Domain IPs | 104.21.72.177, 172.67.153.86, 2606:4700:3034::6815:48b1, 2606:4700:3037::ac43:9956 |
| Response IP | 104.21.72.177 |
| Found | Yes |
| Hash | b7898f39fd0e04a381b5c34415052b5d26409ee29d81db700fd1e0282fa53a72 |
| SimHash | 0171c4f3a350 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /cgi-bin |
| Disallow | /wp-admin |
| Disallow | /wp-includes |
| Disallow | /wp-content/plugins |
| Disallow | /wp-content/cache |
| Disallow | /wp-content/themes |
| Disallow | /wp-trackback |
| Disallow | /wp-feed |
| Disallow | /wp-comments |
| Disallow | */trackback |
| Disallow | */feed |
| Disallow | */comments |
| Disallow | /goto/* |
| Disallow | /out/* |
| Disallow | */page/* |
| Disallow | /*utm* |
| Disallow | /?attachment_id* |
| Disallow | */?* |
| Disallow | /content_manager |
Other Records
| Field | Value |
|---|---|
| sitemap | https://bg-homes.ru/sitemap.xml |
Warnings
- `host` is not a known field.