vataa.com
robots.txt

Robots Exclusion Standard data for vataa.com

Resource Scan

Scan Details

Site Domain vataa.com
Base Domain vataa.com
Scan Status Ok
Last Scan2025-03-23T11:55:52+00:00
Next Scan 2025-04-22T11:55:52+00:00

Last Scan

Scanned2025-03-23T11:55:52+00:00
URL https://vataa.com/robots.txt
Domain IPs 78.140.190.62
Response IP 78.140.190.62
Found Yes
Hash a27b8f03bd484a6dbf79fb859dffe9bdd952a1d5f2e40b7f7873da07257e6a60
SimHash 407bd8826898

Groups

*

Rule Path
Disallow /go
Disallow /video
Disallow /*/search/
Disallow /hdvideo
Disallow *?filter*
Disallow /o.php
Disallow /emb
Disallow /suggestions
Disallow /reports
Disallow /fpi
Disallow *?tst*

Other Records

Field Value
crawl-delay 2

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

proximic

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

Warnings

  • 2 invalid lines.