bubblealba.com
robots.txt

Robots Exclusion Standard data for bubblealba.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	bubblealba.com
Base Domain	bubblealba.com
Scan Status	Ok
Last Scan	2025-11-20T04:38:17+00:00
Next Scan	2025-12-20T04:38:17+00:00

Last Scan

Scanned	2025-11-20T04:38:17+00:00
URL	https://bubblealba.com/robots.txt
Domain IPs	172.66.40.78, 172.66.43.178, 2606:4700:3108::ac42:284e, 2606:4700:3108::ac42:2bb2
Response IP	172.66.40.78
Found	Yes
Hash	7ff807f41c1a05e8688e2dbb1e207ae1d157786d698b3ddeeaa4a8b2b3636415
SimHash	74364f71e642

Groups

*

Rule	Path
Allow	/
Disallow	/m/

Rule

Path

Allow

Disallow

/m/

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

python-requests

Rule	Path
Disallow	/

Rule

Path

Disallow

go-http-client

Rule	Path
Disallow	/

Rule

Path

Disallow

okhttp

Rule	Path
Disallow	/

Rule

Path

Disallow

java

Rule	Path
Disallow	/

Rule

Path

Disallow

curl

Rule	Path
Disallow	/

Rule

Path

Disallow

censysinspect

Rule	Path
Disallow	/

Rule

Path

Disallow

masscan

Rule	Path
Disallow	/

Rule

Path

Disallow

zgrab

Rule	Path
Disallow	/

Rule

Path

Disallow

spbot

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow	/

Rule

Path

Disallow

velenpublicwebcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

cohere-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalagent

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalfetcher

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow	/

Rule

Path

Disallow

ai2bot

Rule	Path
Disallow	/libwww-perl

Rule

Path

Disallow

/libwww-perl

cohere-training-data-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

youbot

Rule	Path
Disallow	/

Rule

Path

Disallow

diffbot

Rule	Path
Disallow	/

Rule

Path

Disallow

crawlspace

Rule	Path
Disallow	/

Rule

Path

Disallow

omgili

Rule	Path
Disallow	/

Rule

Path

Disallow

yisouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

awariobot

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

mauibot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

wget

Rule	Path
Disallow	/

Rule

Path

Disallow

winhttp

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

idbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mfibot

Rule	Path
Disallow	/

Rule

Path

Disallow

smtbot

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://bubblealba.com/sitemap.xml

Field

Value

sitemap

https://bubblealba.com/sitemap.xml

bubblealba.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

scrapy

python-requests

go-http-client

okhttp

java

curl

censysinspect

masscan

zgrab

spbot

serpstatbot

velenpublicwebcrawler

gptbot

claudebot

bytespider

ccbot

cohere-ai

anthropic-ai

google-extended

meta-externalagent

meta-externalfetcher

applebot

perplexitybot

ai2bot

cohere-training-data-crawler

youbot

diffbot

crawlspace

omgili

yisouspider

amazonbot

awariobot

baiduspider

dataforseobot

mauibot

semrushbot

wget

winhttp

blexbot

rogerbot

mail.ru_bot

idbot

mfibot

smtbot

Other Records

bubblealba.com
robots.txt