fshd.link
robots.txt

Robots Exclusion Standard data for fshd.link

Archived Snapshots

Resource Scan

Scan Details

Site Domain	fshd.link
Base Domain	fshd.link
Scan Status	Ok
Last Scan	2025-04-29T03:50:43+00:00
Next Scan	2025-05-29T03:50:43+00:00

Last Scan

Scanned	2025-04-29T03:50:43+00:00
URL	https://fshd.link/robots.txt
Domain IPs	104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP	104.21.96.1
Found	Yes
Hash	c9377d484c1b34e7b8af92d2d59b5aa18ca01e678a81ef70c21b21eb07b6596c
SimHash	2014d1922303

Groups

similarweb

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

Rule	Path
Disallow	/

facebookbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot-image

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot-mobile

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot

Rule	Path
Disallow	/

Rule

Path

Disallow

slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

teoma

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

robozilla

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

naverbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yeti

Rule	Path
Disallow	/

Rule

Path

Disallow

yahoo-mmcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

psbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yahoo-blogs/v3.9

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalfetcher

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

omgili

Rule	Path
Disallow	/

Rule

Path

Disallow

timpibot

Rule	Path
Disallow	/

Rule

Path

Disallow

webzio-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

bingpreview

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefssiteaudit

Rule	Path
Disallow	/

Rule

Path

Disallow

google-inspectiontool

Rule	Path
Disallow	/

Rule

Path

Disallow

siteauditbot

Rule	Path
Disallow	/

Rule

Path

Disallow

google web preview

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/

Rule

Path

Disallow

fshd.linkrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

similarweb

ahrefsbot

ccbot

gptbot

dotbot

googlebot

bytespider

meta

facebookbot

anthropic-ai

googlebot

googlebot-image

googlebot-mobile

msnbot

slurp

teoma

gigabot

robozilla

nutch

ia_archiver

baiduspider

naverbot

yeti

yahoo-mmcrawler

psbot

yahoo-blogs/v3.9

chatgpt-user

meta-externalfetcher

applebot-extended

google-extended

omgili

timpibot

webzio-extended

amazonbot

archive.org_bot

bingpreview

ahrefssiteaudit

google-inspectiontool

siteauditbot

google web preview

*

fshd.link
robots.txt