embed.btv.bg
robots.txt

Robots Exclusion Standard data for embed.btv.bg

Resource Scan

Scan Details

Site Domain embed.btv.bg
Base Domain btv.bg
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-05T01:36:59+00:00
Next Scan 2024-06-03T01:36:59+00:00

Last Successful Scan

Scanned2023-08-02T01:23:35+00:00
URL https://embed.btv.bg/robots.txt
Domain IPs 104.18.24.120, 104.18.25.120, 2606:4700::6812:1878, 2606:4700::6812:1978
Response IP 104.18.24.120
Found Yes
Hash 028701816b8330b44b0fee529e274d4013f4b8c3ed963f8b1aa64391db832874
SimHash e83d09d74793

Groups

*

Rule Path
Disallow /bin/logout.php$
Disallow /bin/service/feed/mobile.php$

googlebot

Rule Path
Disallow /bin/logout.php$
Disallow /bin/service/feed/mobile.php$

googlebot-news

Rule Path
Disallow /bin/logout.php$
Disallow /bin/service/feed/mobile.php$

googlebot-image

Rule Path
Disallow /bin/logout.php$
Disallow /bin/service/feed/mobile.php$

googlebot-mobile

Rule Path
Disallow /bin/logout.php$
Disallow /bin/service/feed/mobile.php$

Other Records

Field Value
sitemap https://btvnovinite.bg/lbin/v3/sitemap.php?sitemap=menu
sitemap https://btvnovinite.bg/lbin/v3/sitemap.php
sitemap https://btvnovinite.bg/lbin/v3/sitemap.php?sitemap=news