big5.lwltv.com
robots.txt

Robots Exclusion Standard data for big5.lwltv.com

Resource Scan

Scan Details

Site Domain big5.lwltv.com
Base Domain lwltv.com
Scan Status Ok
Last Scan2025-02-20T07:53:59+00:00
Next Scan 2025-03-22T07:53:59+00:00

Last Scan

Scanned2025-02-20T07:53:59+00:00
URL https://big5.lwltv.com/robots.txt
Domain IPs 104.21.93.33, 172.67.204.51, 2606:4700:3035::ac43:cc33, 2606:4700:3037::6815:5d21
Response IP 172.67.204.51
Found Yes
Hash d88b7f439e464295cf4e86dd3f66f3276a302d82d8165b5d0f182366cc85f571
SimHash 1a5fc5625af3

Groups

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

facebookexternalhit

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

wbsearchbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

screenerbot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

*

Rule Path
Disallow

Warnings

  • 4 invalid lines.