amay.be
robots.txt
Robots Exclusion Standard data for amay.be
Resource Scan
Scan Details
| Site Domain | amay.be |
| Base Domain | amay.be |
| Scan Status | Ok |
| Last Scan | 2025-10-07T13:06:06+00:00 |
| Next Scan | 2025-11-06T13:06:06+00:00 |
Last Scan
| Scanned | 2025-10-07T13:06:06+00:00 |
| URL | https://amay.be/robots.txt |
| Redirect | https://static.imio.be/robots.txt |
| Redirect Domain | static.imio.be |
| Redirect Base | imio.be |
| Domain IPs | 188.165.186.179, 188.165.186.183 |
| Redirect IPs | 91.121.217.25 |
| Response IP | 91.121.217.25 |
| Found | Yes |
| Hash | 9922bf32d3d64293b408fbda70d5a8921a32d2c4c0587e8e3d79346387ee9c55 |
| SimHash | 719753f2cb60 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /%40%40search* |
| Disallow | /search* |
| Disallow | /*refreshCalendar* |
| Disallow | /*resolveuid* |
| Disallow | /*folder_contents* |
| Disallow | /*year* |
| Disallow | /*month* |
| Disallow | /*day* |
| Disallow | set_language |
| Disallow | login_form |
| Disallow | /images |
| Disallow | /db* |
| Disallow | /default.asp* |
| Disallow | /*sendto_form$ |
| Disallow | /*sendtomanager_form$ |
| Disallow | /*folder_factories$ |
| Disallow | /*index_html |
| Disallow | /*index.html |
| Disallow | /*weekbyday* |
| Disallow | /*weekbyhour* |
| Disallow | /*?currentDate* |
| Disallow | /*?b_start* |
| Disallow | /*document-generation* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 120 |
ahrefsbot
alexibot
amazonbot
aqua_products
aspiegelbot
awariorssbot
awariosmartbot
blexbot
backdoorbot/1.0
blowfish/1.0
bookmark search tool
botalot
botrighthere
builtbottough
bullseye/1.0
bunnyslippers
chatgpt-user
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copernic
copyrightcheck
crescent
crescent internet toolpak http ole control v.1.0
dittospyder
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
fairad client
fasterfox
flaming attackbot
foobot
gptbot
gaisbot
getright/4.2
httrack 3.0
harvest/1.5
iconsurf
infonavirobot
iron33/1.0.2
jennybot
kenjin spider
keyword density/0.9
lnspiderguy
lexibot
linkscan/8.1a unix
linkwalker
linkextractorpro
miixpc
miixpc/4.2
mj12bot
ms search
msiecrawler
mata hari
mauibot
megaindex.ru/2.0
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
mister pix
mozilla/4.0 (compatible; bullseye; windows 95)
nicerspro
netants
oai-searchbot
ocelli
offline explorer
openbot
openfind
openfind data gatherer
oracle ultra search
perman
propowerbot/2.14
prowebwalker
queryn metasearch
rma
radiation retriever 1.1
repomonkey
repomonkey bait & tackle/v1.01
seekportbot
semrushbot
semrushbot-ba
semrushbot-coub
semrushbot-ct
semrushbot-si
semrushbot-swa
siteauditbot
sitesnagger
spankbot
speedy
splitsignalbot
surveybot
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
true_robot
true_robot/1.0
turnitinbot
turnitinbot/1.5
twiceler
url control
url_spider_pro
urly warning
vci
vci webviewer vci webviewer win32
www-collector-e
web image collector
webauto
webbandit
webbandit/3.50
webcapture 2.0
webcopier
webcopier v.2.2
webcopier v3.2a
webenhancer
websauger
webstripper
webzip/4.21
webzip/5.0
webzip
webzip
webzip/4.0
website quester
webster pro
xenu's
xenu's link sleuth 1.1c
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
aipbot
asterias
b2w/0.1
becomebot
cosmos
dotbot
facebookcatalog/1.0
hloader
httplib
humanlinks
ia_archiver
larbin
libweb/clshttp
lwp-trivial
lwp-trivial/1.34
meta-externalagent
moget
moget/2.1
psbot
searchpreview
spanner
suzuran
tocrawl/urldispatcher
turingos
| Rule | Path |
|---|---|
| Disallow | / |
Comments