hdvideo.best
robots.txt

Robots Exclusion Standard data for hdvideo.best

Resource Scan

Scan Details

Site Domain hdvideo.best
Base Domain hdvideo.best
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-01-16T17:08:07+00:00
Next Scan 2025-04-16T17:08:07+00:00

Last Successful Scan

Scanned2023-09-02T00:01:23+00:00
URL https://hdvideo.best/robots.txt
Domain IPs 104.21.30.190, 172.67.173.138, 2606:4700:3035::ac43:ad8a, 2606:4700:3037::6815:1ebe
Response IP 104.21.30.190
Found Yes
Hash 87860ceb3deb40ccb17a594a5888b430451b9c11e5d080cba2e6aa26ff849192
SimHash 4d0d81628831

Groups

*

Rule Path
Disallow /user/
Disallow /backup/
Disallow /engine/
Disallow /language/
Disallow /upgrade/
Disallow /autobackup.php
Disallow /admin.php
Disallow /newposts/
Disallow /lastnews/
Disallow /engine/go.php
Disallow /engine/download.php
Disallow /statistics.html
Disallow /*subaction%3Duserinfo
Disallow /*subaction%3Dnewposts
Disallow /*do%3Dlastcomments
Disallow /*do%3Dfeedback
Disallow /*do%3Dregister
Disallow /*do%3Dlostpassword
Disallow /*do%3Daddnews
Disallow /*do%3Dstats
Disallow /*do%3Dpm
Disallow /xfsearch/
Disallow /?do=actors
Disallow /?do=actor
Disallow /statistics.html
Disallow /out/
Disallow /blocks/
Disallow *.php*
Disallow */page/*
Disallow /page*
Disallow /index.php?do=orderdesc*
Disallow /playlists/*
Disallow /?*

ahrefsbot/5.1

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot/7~bl

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

yandex

Rule Path
Allow /$
Disallow /

yandexbot

Rule Path
Allow /$
Disallow /

Other Records

Field Value
sitemap /sitemap.xml