bonusvid.com
robots.txt

Robots Exclusion Standard data for bonusvid.com

Resource Scan

Scan Details

Site Domain bonusvid.com
Base Domain bonusvid.com
Scan Status Ok
Last Scan2025-04-19T04:14:11+00:00
Next Scan 2025-05-19T04:14:11+00:00

Last Scan

Scanned2025-04-19T04:14:11+00:00
URL https://bonusvid.com/robots.txt
Domain IPs 78.140.190.59
Response IP 78.140.190.59
Found Yes
Hash f0a49441334a7f0898705913dbfc5e5c1dfee7203dc787dad3a6fa1630c3efff
SimHash 603bd8c0e898

Groups

*

Rule Path
Disallow /go
Disallow /o.php
Disallow /*/search/
Disallow *?filter*
Disallow /emb
Disallow /suggestions
Disallow /reports
Disallow /fpi
Disallow *?tst*

Other Records

Field Value
crawl-delay 2

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

Other Records

Field Value
sitemap https://bonusvid.com/sitemap.xml

Warnings

  • 2 invalid lines.