bougovbd.com
robots.txt

Robots Exclusion Standard data for bougovbd.com

Resource Scan

Scan Details

Site Domain bougovbd.com
Base Domain bougovbd.com
Scan Status Ok
Last Scan2026-03-16T06:21:35+00:00
Next Scan 2026-04-15T06:21:35+00:00

Last Scan

Scanned2026-03-16T06:21:35+00:00
URL https://bougovbd.com/robots.txt
Domain IPs 2a02:4780:16:d81d:1a8a:d554:bf9e:af8c, 2a02:4780:38:cde1:dffb:4ce:ab3c:c787, 77.37.115.116, 91.108.100.168
Response IP 77.37.48.183
Found Yes
Hash 23586c996d0ef969d07eeb2c6b0375f51ccda44a5a9fa584317148382b9c4036
SimHash 6010de9547b3

Groups

lumen*

Rule Path
Disallow /

dmcabot*

Rule Path
Disallow /

chillingeffects*

Rule Path
Disallow /

copyscape*

Rule Path
Disallow /

plagiarismbot*

Rule Path
Disallow /

dmcachecker*

Rule Path
Disallow /

copyrightbot*

Rule Path
Disallow /

antipiracybot*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

*

Rule Path
Allow /

googlebot

Rule Path
Disallow

googlebot-image
googlebot-mobile

Rule Path
Disallow

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap https://bougovbd.com/sitemap.xml