vrwab.live
robots.txt

Robots Exclusion Standard data for vrwab.live

Resource Scan

Scan Details

Site Domain vrwab.live
Base Domain vrwab.live
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-19T10:10:19+00:00
Next Scan 2025-07-18T10:10:19+00:00

Last Successful Scan

Scanned2023-09-05T07:14:39+00:00
URL https://vrwab.live/robots.txt
Redirect https://rtwab.xyz/robots.txt
Redirect Domain rtwab.xyz
Redirect Base rtwab.xyz
Domain IPs 104.21.53.10, 172.67.207.67, 2606:4700:3035::ac43:cf43, 2606:4700:3036::6815:350a
Redirect IPs 104.21.44.181, 172.67.202.100, 2606:4700:3036::6815:2cb5, 2606:4700:3037::ac43:ca64
Response IP 104.21.44.181
Found Yes
Hash 4d1696fe0c07e4f9296d5d8125cfb2e7d071e429c9628f1f99fe40fc51163c48
SimHash 4d14cbb7c6d1

Groups

googlebot
googlebot-image
googlebot-mobile
googlebot-news
googlebot-video
adsbot-google-mobile
adsbot-google
mediapartners-google
googlebot-image/1.0
googlebot-news
googlebot-video/1.0
google favicon
storebot-google
google-inspectiontool
googleother
apis-google

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

duckduckbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

baiduspider
baiduspider-video
baiduspider-image
baiduspider-news

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yahoo slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

*

Rule Path
Disallow /