hedgefundnamegenerator.com
robots.txt

Robots Exclusion Standard data for hedgefundnamegenerator.com

Resource Scan

Scan Details

Site Domain hedgefundnamegenerator.com
Base Domain hedgefundnamegenerator.com
Scan Status Ok
Last Scan2026-02-10T14:02:58+00:00
Next Scan 2026-02-17T14:02:58+00:00

Last Scan

Scanned2026-02-10T14:02:58+00:00
URL https://hedgefundnamegenerator.com/robots.txt
Redirect https://www.hedgefundnamegenerator.com//robots.txt
Redirect Domain www.hedgefundnamegenerator.com
Redirect Base hedgefundnamegenerator.com
Domain IPs 164.132.164.80, 2001:41d0:1008:1850::1
Redirect IPs 164.132.164.80, 2001:41d0:1008:1850::1
Response IP 164.132.164.80
Found Yes
Hash 70f5b368c8ed4acea7a77dd06eac22922e30c48ff3fe3721fffacdb53989a109
SimHash 769e4b41c2e4

Groups

*
mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

ai2bot
ai2bot-dolma
aihitbot
amazonbot
anthropic-ai
applebot
applebot-extended
brightbot 1.0
bytespider
ccbot
chatgpt-user
claude-web
claudebot
cohere-ai
cohere-training-data-crawler
cotoyogi
crawlspace
diffbot
duckassistbot
facebookbot
factset_spyderbot
firecrawlagent
friendlycrawler
google-cloudvertexbot
google-extended
googleother
googleother-image
googleother-video
gptbot
iaskspider/2.0
icc-crawler
imagesiftbot
img2dataset
imgproxy
isscyberriskcrawler
kangaroo bot
meta-externalagent
meta-externalagent
meta-externalfetcher
meta-externalfetcher
novaact
oai-searchbot
omgili
omgilibot
operator
pangubot
perplexity-user
perplexitybot
petalbot
qualifiedbot
scrapy
semrushbot-ocob
semrushbot-swa
sidetrade indexer bot
tiktokspider
timpibot
velenpublicwebcrawler
webzio-extended
youbot

Rule Path
Disallow /

Warnings

  • `request-rate` is not a known field.