virtualflowers.com
robots.txt

Robots Exclusion Standard data for virtualflowers.com

Resource Scan

Scan Details

Site Domain virtualflowers.com
Base Domain virtualflowers.com
Scan Status Ok
Last Scan2024-09-08T17:02:11+00:00
Next Scan 2024-10-08T17:02:11+00:00

Last Scan

Scanned2024-09-08T17:02:11+00:00
URL https://virtualflowers.com/robots.txt
Domain IPs 104.26.6.224, 104.26.7.224, 172.67.72.249, 2606:4700:20::681a:6e0, 2606:4700:20::681a:7e0, 2606:4700:20::ac43:48f9
Response IP 104.26.7.224
Found Yes
Hash bc865ee2b3330003bd2e783536ef2e24ab9347e3f76273bf12cacd4e01d1df37
SimHash 683e4043e4b5

Groups

*

No rules defined. All paths allowed.

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 8

facebookbot

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

meta-externalagent

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 30

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

chatgpt-user

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatglm-spider

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

blackboard safeassign

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

crawler4j

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

liebaofast

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mauibot (crawler.feedback+wc@gmail.com)

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

mqqbrowser

Rule Path
Disallow /

nimbostratus-bot/v1.3.2

Rule Path
Disallow /

seekport crawler

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

sputnikbot/2.3

Rule Path
Disallow /

the knowledge ai

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ucbrowser

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

yeti

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

Warnings

  • 1 invalid line.