udf.by
robots.txt
Robots Exclusion Standard data for udf.by
Resource Scan
Scan Details
| Site Domain | udf.by |
| Base Domain | udf.by |
| Scan Status | Ok |
| Last Scan | 2024-10-31T20:15:14+00:00 |
| Next Scan | 2024-11-07T20:15:14+00:00 |
Last Scan
| Scanned | 2024-10-31T20:15:14+00:00 |
| URL | https://udf.by/robots.txt |
| Redirect | https://udf.name/robots.txt |
| Redirect Domain | udf.name |
| Redirect Base | udf.name |
| Domain IPs | 104.21.53.173, 172.67.215.210, 2606:4700:3033::ac43:d7d2, 2606:4700:3035::6815:35ad |
| Redirect IPs | 104.21.38.7, 172.67.216.186, 2606:4700:3030::6815:2607, 2606:4700:3037::ac43:d8ba |
| Response IP | 104.21.38.7 |
| Found | Yes |
| Hash | cacd33e7a114a5ff7205b05dd6c434ac70269fc18a41dd7036698532584ffbf3 |
| SimHash | a14d3e13c2a1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /engine/go.php |
| Disallow | /anons/ |
| Disallow | /feedback.html |
| Disallow | /udf/ |
| Disallow | /engine/ |
| Disallow | /socialnyj-marsh/ |
| Disallow | /polish/ |
| Disallow | /xfsearch/ |
| Disallow | /ah1n1/ |
| Disallow | /free_video/ |
| Disallow | /free_fotos/ |
| Disallow | /free_top/ |
| Disallow | /free-news/ |
| Disallow | /sub/ |
| Disallow | /vybor/cik/ |
| Disallow | /web/ |
| Disallow | /main-free/ |
| Disallow | /free_day/ |
| Disallow | /spring96/ |
| Disallow | /elect-news/ |
| Disallow | /main-elect/ |
| Disallow | /shlyah/ |
| Disallow | /charnobylski-shlyax/ |
| Disallow | /*do%3Dgo |
| Disallow | /print%3Apage |
| Disallow | /english/syuzhety/ |
| Disallow | /english/photos/ |
| Disallow | /vybor/multimedia/ |
| Disallow | /president2019/ |
| Disallow | /cdn-cgi/ |
| Disallow | /all/ |
| Disallow | /posrednik/ |
| Disallow | /sites/ |
| Disallow | /pol/ |
| Allow | /style/ |
| Allow | /index.php?action=mobile |
| Allow | /index.php?action_skin_change=yes&skin_name=engnews |
Other Records
| Field | Value |
|---|---|
| sitemap | https://udf.name/uploads/sitemap.xml |
Warnings
- `host` is not a known field.