survivor.btv.bg
robots.txt

Robots Exclusion Standard data for survivor.btv.bg

Resource Scan

Scan Details

Site Domain survivor.btv.bg
Base Domain btv.bg
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-03-19T21:14:13+00:00
Next Scan 2024-06-17T21:14:13+00:00

Last Successful Scan

Scanned2023-07-30T20:31:29+00:00
URL https://survivor.btv.bg/robots.txt
Domain IPs 104.18.24.120, 104.18.25.120, 2606:4700::6812:1878, 2606:4700::6812:1978
Response IP 104.18.24.120
Found Yes
Hash 5f3d74cc199884a43d94703c272c9a303728527c5a9db51212ba3086ebd56eed
SimHash 455d1fd774d7

Groups

*
googlebot
googlebot-news
googlebot-image
googlebot-mobile

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://survivor.btv.bg/lbin/v3/sitemap.php?sitemap=menu
sitemap https://survivor.btv.bg/lbin/v3/sitemap.php
sitemap https://survivor.btv.bg/lbin/v3/sitemap.php?sitemap=news