cyberbytecafe.net
robots.txt

Robots Exclusion Standard data for cyberbytecafe.net

Archived Snapshots

Resource Scan

Scan Details

Site Domain	cyberbytecafe.net
Base Domain	cyberbytecafe.net
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Couldn't connect to server.
Last Scan	2025-08-26T20:55:18+00:00
Next Scan	2025-11-24T20:55:18+00:00

Last Successful Scan

Scanned	2023-07-16T19:47:49+00:00
URL	https://cyberbytecafe.net/robots.txt
Domain IPs	104.21.46.87, 172.67.137.3, 2606:4700:3031::ac43:8903, 2606:4700:3033::6815:2e57
Response IP	104.21.46.87
Found	Yes
Hash	cbd84bd3af547903f8b7386bb7815263dff5b12a416d9f303d8bba6683c2bb66
SimHash	12754450d11a

Groups

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ia_archiver

Rule	Path
Disallow	/

Rule

Path

Disallow

scoutjet

Rule	Path
Disallow	/

Rule

Path

Disallow

sistrix

Rule	Path
Disallow	/

Rule

Path

Disallow

searchmetricsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks-robot

Rule	Path
Disallow	/

Rule

Path

Disallow

lipperhey spider

Rule	Path
Disallow	/

Rule

Path

Disallow

exabot

Rule	Path
Disallow	/

Rule

Path

Disallow

ncbot

Rule	Path
Disallow	/

Rule

Path

Disallow

backlinkcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

archive.org_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

meanpathbot

Rule	Path
Disallow	/

Rule

Path

Disallow

pagesinventory

Rule	Path
Disallow	/

Rule

Path

Disallow

aboundexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

linkdexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

gigabot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ezooms

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-12

Rule	Path
Disallow	/

Rule

Path

Disallow

majestic-seo

Rule	Path
Disallow	/

Rule

Path

Disallow

dsearch

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12

Rule	Path
Disallow	/

Rule

Path

Disallow

blekkobot

Rule	Path
Disallow	/

Rule

Path

Disallow

nerdybot

Rule	Path
Disallow	/

Rule

Path

Disallow

jamesbot

Rule	Path
Disallow	/

Rule

Path

Disallow

tineye

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstat

Rule	Path
Disallow	/

Rule

Path

Disallow

spyfu

Rule	Path
Disallow	/

Rule

Path

Disallow

prlog

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://cyberbytecafe.net/sitemap_index.xml

Field

Value

sitemap

https://cyberbytecafe.net/sitemap_index.xml

Comments

START YOAST BLOCK
---------------------------
---------------------------
END YOAST BLOCK

cyberbytecafe.netrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

ahrefsbot

mj12bot

rogerbot

semrushbot

ia_archiver

scoutjet

sistrix

searchmetricsbot

seokicks-robot

lipperhey spider

exabot

ncbot

backlinkcrawler

archive.org_bot

meanpathbot

pagesinventory

aboundexbot

spbot

linkdexbot

gigabot

dotbot

nutch

blexbot

ezooms

majestic-12

majestic-seo

dsearch

mj12

blekkobot

nerdybot

jamesbot

tineye

baiduspider

serpstat

spyfu

prlog

*

Other Records

Comments

cyberbytecafe.net
robots.txt