Log In Sign Up

zbtube.tv
robots.txt

Robots Exclusion Standard data for zbtube.tv

Resource Scan

Scan Details

Site Domain zbtube.tv
Base Domain zbtube.tv
Scan Status Ok
Last Scan4/26/2025, 2:30:17 AM
Next Scan 5/26/2025, 2:30:17 AM

Last Scan

Scanned4/26/2025, 2:30:17 AM
URL https://zbtube.tv/robots.txt
Domain IPs 104.21.44.85, 172.67.198.23, 2606:4700:3030::ac43:c617, 2606:4700:3037::6815:2c55
Response IP 104.21.44.85
Found Yes
Hash 1910bfd17694e996dc76a26d2eeac2acec9c2e088695cd754c5b0f4e3a3ae7d1
SimHash 4f1fc100cab8

Groups

*

Rule Path
Disallow /*.json$
Disallow /*.js$
Disallow /api/
Disallow /e/
Disallow /health/
Disallow /_page-perf/
Disallow /_player-perf/
Disallow /_client-error/

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

sogou

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /
Allow /$

blexbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://zbtube.tv/sitemap.xml
Back to top

Warnings

  • 2 invalid lines.
Back to top