focus.bg
robots.txt
Robots Exclusion Standard data for focus.bg
Resource Scan
Scan Details
Site Domain | focus.bg |
Base Domain | focus.bg |
Scan Status | Ok |
Last Scan | 2024-11-12T11:13:57+00:00 |
Next Scan | 2024-11-19T11:13:57+00:00 |
Last Scan
Scanned | 2024-11-12T11:13:57+00:00 |
URL | https://focus.bg/robots.txt |
Redirect | https://fakti.bg/robots.txt |
Redirect Domain | fakti.bg |
Redirect Base | fakti.bg |
Domain IPs | 104.26.0.79, 104.26.1.79, 172.67.70.2 |
Redirect IPs | 104.26.2.90, 104.26.3.90, 172.67.68.14 |
Response IP | 104.26.2.90 |
Found | Yes |
Hash | 4f4956b8b97d3e4b7dd783a18bd44d15ca984aac43ace73e0725c6586506479f |
SimHash | 0d004862cfd3 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /captcha/* |
Disallow | /search?q=* |
Disallow | /terms |
Disallow | /citati* |
Disallow | /vchera |
Disallow | /novinite-dnes |
Other Records
Field | Value |
---|---|
sitemap | https://fakti.bg/sitemap.xml |
sitemap | https://fakti.bg/sitemapNews.xml |
sitemap | https://fakti.bg/sitemap-images.xml |
sitemap | https://fakti.bg/sitemapNews-images.xml |
Warnings
- `host` is not a known field.