Log In Sign Up

hdhq.xxx
robots.txt

Robots Exclusion Standard data for hdhq.xxx

Resource Scan

Scan Details

Site Domain hdhq.xxx
Base Domain hdhq.xxx
Scan Status Ok
Last Scan2025-09-26T00:22:39+00:00
Next Scan 2025-10-26T00:22:39+00:00

Last Scan

Scanned2025-09-26T00:22:39+00:00
URL https://hdhq.xxx/robots.txt
Domain IPs 104.21.20.35, 172.67.191.75, 2606:4700:3031::6815:1423, 2606:4700:3032::ac43:bf4b
Response IP 104.21.20.35
Found Yes
Hash 3e5ad3ba62dc6e437302c85f353bd31e73e8d900d2f823cc3054d3e31834f822
SimHash 231d927063a0

Groups

*

Rule Path
Disallow /*/video/*
Disallow /*/terms
Disallow /*/privacy
Disallow /*/faq
Disallow /*/dmca
Disallow /*/get-listed
Disallow /*/contact
Disallow /*/liked
Disallow /*/watch-later
Disallow /*/clicked
Disallow /*/*long%3Dlong*
Disallow /*/*order%3Ddate*
Disallow /*/pornstar/*/long*
Disallow /*/pornstar/*/order/date*
Disallow /*/category/*/long*
Disallow /*/category/*/order/date*
Disallow /*/search/*/long*
Disallow /*/search/*/order/date*
Disallow /*/js
Disallow /*/css
Disallow /*/page/
Disallow /api/*
Disallow /accessblocked

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexbot

Rule Path
Allow /en
Allow /ru
Allow /tr
Disallow /

Other Records

Field Value
crawl-delay 60

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://hdhq.xxx/sitemap.xml
Back to top