choothub.com
robots.txt

Robots Exclusion Standard data for choothub.com

Resource Scan

Scan Details

Site Domain choothub.com
Base Domain choothub.com
Scan Status Ok
Last Scan2025-10-07T02:56:27+00:00
Next Scan 2025-11-06T02:56:27+00:00

Last Scan

Scanned2025-10-07T02:56:27+00:00
URL https://choothub.com/robots.txt
Domain IPs 104.21.75.250, 172.67.184.139, 2606:4700:3032::ac43:b88b, 2606:4700:3037::6815:4bfa
Response IP 104.21.75.250
Found Yes
Hash 60d17a9fbce4bd86627befd0050beb2ef59579cf19e3968ae730f4d0cf3ed1ce
SimHash 231fd27163a0

Groups

*

Rule Path
Disallow /*/video/*
Disallow /*/terms
Disallow /*/privacy
Disallow /*/faq
Disallow /*/dmca
Disallow /*/get-listed
Disallow /*/contact
Disallow /*/liked
Disallow /*/watch-later
Disallow /*/clicked
Disallow /*/*long%3Dlong*
Disallow /*/*order%3Ddate*
Disallow /*/pornstar/*/long*
Disallow /*/pornstar/*/order/date*
Disallow /*/category/*/long*
Disallow /*/category/*/order/date*
Disallow /*/search/*/long*
Disallow /*/search/*/order/date*
Disallow /*/js
Disallow /*/css
Disallow /*/page/
Disallow /api/*
Disallow /accessblocked

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

yandexbot

Rule Path
Allow /en
Allow /ru
Allow /tr
Disallow /

Other Records

Field Value
crawl-delay 60

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://choothub.com/sitemap.xml