realestates.bg
robots.txt
Robots Exclusion Standard data for realestates.bg
Resource Scan
Scan Details
| Site Domain | realestates.bg |
| Base Domain | realestates.bg |
| Scan Status | Ok |
| Last Scan | 2024-10-03T13:51:02+00:00 |
| Next Scan | 2024-10-10T13:51:02+00:00 |
Last Scan
| Scanned | 2024-10-03T13:51:02+00:00 |
| URL | https://realestates.bg/robots.txt |
| Redirect | https://en.realestates.bg/robots.txt |
| Redirect Domain | en.realestates.bg |
| Redirect Base | realestates.bg |
| Domain IPs | 82.118.229.98 |
| Redirect IPs | 82.118.229.98 |
| Response IP | 82.118.229.98 |
| Found | Yes |
| Hash | f7adc2100187a86b8a3c9ab1d42b44d892460e8d53818763eb4ba8483a403e67 |
| SimHash | 507acc6b4a2a |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /top.php* |
| Disallow | /login.php* |
| Disallow | /sharer.php* |
| Disallow | /*section_ids%3D* |
| Disallow | /*p%5B846%5D%3D* |
| Disallow | /*p%5B847%5D%3D* |
| Disallow | /*p%5B848%5D%3D* |
| Disallow | /*p%5B849%5D%3D* |
| Disallow | /*p%5B850%5D%3D* |
| Disallow | /*p%5B853%5D%3D* |
| Disallow | /*p%5B865%5D%3D* |
| Disallow | /*price%3D* |
| Disallow | /*after_date%3D* |
| Disallow | /*after_hour%3D* |
| Disallow | /*io%3D1* |
| Allow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Comments