fluxai.ca
robots.txt

Robots Exclusion Standard data for fluxai.ca

Archived Snapshots

Resource Scan

Scan Details

Site Domain	fluxai.ca
Base Domain	fluxai.ca
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Couldn't connect to server.
Last Scan	2025-08-15T20:14:04+00:00
Next Scan	2025-11-13T20:14:04+00:00

Last Successful Scan

Scanned	2025-03-26T14:31:52+00:00
URL	http://fluxai.ca/robots.txt
Domain IPs	45.33.3.184
Response IP	45.33.3.184
Found	Yes
Hash	bceff3d729523288327e4dfd9db0aad0ec3fa9f189b93188de820e0e0f99b7ee
SimHash	74195957e081

Groups

*

Rule	Path
Disallow	wp-configs.php
Disallow	themes.php
Disallow	wp-info.php
Disallow	xmrlpc.php
Disallow	function.php
Disallow	wp-login.php
Disallow	wp-admin.php

Rule

Path

Disallow

wp-configs.php

Disallow

themes.php

Disallow

wp-info.php

Disallow

xmrlpc.php

Disallow

function.php

Disallow

wp-login.php

Disallow

wp-admin.php

bingbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	30

Field

Value

crawl-delay

yandexbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	30

Field

Value

crawl-delay

semrushbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	30

Field

Value

crawl-delay

siteauditbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	30

Field

Value

crawl-delay

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

anthropic-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

awariorssbot
awariosmartbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

ccbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

claudebot

Rule	Path
Disallow	/

Rule

Path

Disallow

claude-web

Rule	Path
Disallow	/

Rule

Path

Disallow

cohere-ai

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

diffbot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookbot

Rule	Path
Disallow	/

Rule

Path

Disallow

friendlycrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

google-cloudvertexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

google-extended

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

imagesiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

magpie-crawler

Rule	Path
Disallow	/

Rule

Path

Disallow

meta-externalagent
meta-externalagent

Rule	Path
Disallow	/

Rule

Path

Disallow

newsnow

Rule	Path
Disallow	/

Rule

Path

Disallow

news-please

Rule	Path
Disallow	/

Rule

Path

Disallow

oai-searchbot

Rule	Path
Disallow	/

Rule

Path

Disallow

omgili

Rule	Path
Disallow	/

Rule

Path

Disallow

omgilibot

Rule	Path
Disallow	/

Rule

Path

Disallow

peer39_crawler
peer39_crawler/1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

perplexitybot

Rule	Path
Disallow	/

Rule

Path

Disallow

quora-bot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

turnitinbot

Rule	Path
Disallow	/

Rule

Path

Disallow

Comments

Disallow Rules

fluxai.carobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

*

bingbot

Other Records

yandexbot

Other Records

semrushbot

Other Records

siteauditbot

Other Records

amazonbot

anthropic-ai

applebot-extended

awariorssbotawariosmartbot

bytespider

ccbot

chatgpt-user

claudebot

claude-web

cohere-ai

dataforseobot

diffbot

facebookbot

friendlycrawler

google-cloudvertexbot

google-extended

gptbot

imagesiftbot

magpie-crawler

meta-externalagentmeta-externalagent

newsnow

news-please

oai-searchbot

omgili

omgilibot

peer39_crawlerpeer39_crawler/1.0

perplexitybot

quora-bot

scrapy

turnitinbot

Comments

fluxai.ca
robots.txt

awariorssbot
awariosmartbot

meta-externalagent
meta-externalagent

peer39_crawler
peer39_crawler/1.0