takbo.ph
robots.txt

Robots Exclusion Standard data for takbo.ph

Resource Scan

Scan Details

Site Domain takbo.ph
Base Domain takbo.ph
Scan Status Ok
Last Scan2025-12-05T21:59:05+00:00
Next Scan 2025-12-12T21:59:05+00:00

Last Scan

Scanned2025-12-05T21:59:05+00:00
URL http://takbo.ph/robots.txt
Domain IPs 162.215.248.156
Response IP 162.215.248.156
Found Yes
Hash fc8ad4f3d73bdee4d142e3ca5745b8ed5a871488ce68a0688d27242acf0765de
SimHash 0c59d8d00415

Groups

googlebot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

yahoo-slurp

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

msnbot

Rule Path
Disallow

Other Records

Field Value
crawl-delay 30

*

Rule Path
Disallow /xmlrpc.com

Other Records

Field Value
crawl-delay 50

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /