gbet.com.ph
robots.txt

Robots Exclusion Standard data for gbet.com.ph

Resource Scan

Scan Details

Site Domain gbet.com.ph
Base Domain gbet.com.ph
Scan Status Ok
Last Scan2024-08-26T23:25:28+00:00
Next Scan 2024-09-25T23:25:28+00:00

Last Scan

Scanned2024-08-26T23:25:28+00:00
URL https://gbet.com.ph/robots.txt
Redirect https://www.gbet.com.ph/robots.txt
Redirect Domain www.gbet.com.ph
Redirect Base gbet.com.ph
Domain IPs 107.150.112.246, 35.198.235.127
Redirect IPs 107.150.112.246, 35.198.235.127
Response IP 35.198.235.127
Found Yes
Hash 1a644f3d5573b54742e1ceaa67c71f9f0e3c7f7742130834e83886b02dfcea94
SimHash 8a665b74a39b

Groups

*

Rule Path
Disallow

baiduspider

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

etaospider

Rule Path
Disallow /

huihuispider

Rule Path
Disallow /

gwdangspider

Rule Path
Disallow /

wochachaspider

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogouspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

Warnings

  • 2 invalid lines.