Log In Sign Up

flamco.aalberts-hfc.com
robots.txt

Robots Exclusion Standard data for flamco.aalberts-hfc.com

Resource Scan

Scan Details

Site Domain flamco.aalberts-hfc.com
Base Domain aalberts-hfc.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-07-18T05:41:26+00:00
Next Scan 2025-10-16T05:41:26+00:00

Last Successful Scan

Scanned2024-03-02T19:09:29+00:00
URL https://flamco.aalberts-hfc.com/robots.txt
Domain IPs 104.22.66.161, 104.22.67.161, 172.67.36.159, 2606:4700:10::6816:42a1, 2606:4700:10::6816:43a1, 2606:4700:10::ac43:249f
Response IP 172.67.36.159
Found Yes
Hash 897aac2300d761446de4d0b8fdf0ec9e848ffc779916228be3ffc658e379e24e
SimHash c36dfa728b0b

Groups

baiduspider

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

chinaclaw

Rule Path
Disallow /

custo

Rule Path
Disallow /

disco

Rule Path
Disallow /

download\demon

Rule Path
Disallow /

ecatch

Rule Path
Disallow /

eirgrabber

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

express\webpictures

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

eyenetie

Rule Path
Disallow /

flashget

Rule Path
Disallow /

getright

Rule Path
Disallow /

getweb!

Rule Path
Disallow /

go!zilla

Rule Path
Disallow /

go-ahead-got-it

Rule Path
Disallow /

grabnet

Rule Path
Disallow /

grafula

Rule Path
Disallow /

str21/46hmview

Rule Path
Disallow /

httrack

Rule Path
Disallow /

image\stripper

Rule Path
Disallow /

image\sucker

Rule Path
Disallow /

indy\library

Rule Path
Disallow /

interget

Rule Path
Disallow /

internet\ninja

Rule Path
Disallow /

jetcar

Rule Path
Disallow /

joc\web\spider

Rule Path
Disallow /

larbin

Rule Path
Disallow /

leechftp

Rule Path
Disallow /

mass\downloader

Rule Path
Disallow /

midown\tool

Rule Path
Disallow /

mister\pix

Rule Path
Disallow /

navroad

Rule Path
Disallow /

nearsite

Rule Path
Disallow /

netants

Rule Path
Disallow /

netspider

Rule Path
Disallow /

net\vampire

Rule Path
Disallow /

netzip

Rule Path
Disallow /

octopus

Rule Path
Disallow /

offline\explorer

Rule Path
Disallow /

offline\navigator

Rule Path
Disallow /

pagegrabber

Rule Path
Disallow /

papa\foto

Rule Path
Disallow /

pavuk

Rule Path
Disallow /

pcbrowser

Rule Path
Disallow /

realdownload

Rule Path
Disallow /

str22/46reget

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

smartdownload

Rule Path
Disallow /

superbot

Rule Path
Disallow /

superhttp

Rule Path
Disallow /

takeout

Rule Path
Disallow /

teleport\pro

Rule Path
Disallow /

voideye

Rule Path
Disallow /

web\image\collector

Rule Path
Disallow /

web\sucker

Rule Path
Disallow /

webauto

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webfetch

Rule Path
Disallow /

webgo\is

Rule Path
Disallow /

webleacher

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

website\extractor

Rule Path
Disallow /

website\quester

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webwhacker

Rule Path
Disallow /

webzip

Rule Path
Disallow /

widow

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /all*
Disallow /ua*
Disallow /lux*
Disallow /us-en*
Disallow /*/productsheet/
Disallow /*/docfinder/
Disallow /*/brandportal/
Disallow /*/*/*/*/*/*/*-xxxxx/groups/g%2Bc%2Bp%2Ba%2Bnr%2Bview
Disallow /uk-en/pageid/form-flamconnect-remote-registration

Other Records

Field Value
crawl-delay 10
Back to top

Other Records

Field Value
sitemap https://flamco.aalberts-hfc.com/sitemap.xml
Back to top