horaire-mairie.fr
robots.txt

Robots Exclusion Standard data for horaire-mairie.fr

Resource Scan

Scan Details

Site Domain horaire-mairie.fr
Base Domain horaire-mairie.fr
Scan Status Ok
Last Scan2024-09-21T12:34:40+00:00
Next Scan 2024-09-28T12:34:40+00:00

Last Scan

Scanned2024-09-21T12:34:40+00:00
URL https://horaire-mairie.fr/robots.txt
Redirect https://www.horaire-mairie.fr/robots.txt
Redirect Domain www.horaire-mairie.fr
Redirect Base horaire-mairie.fr
Domain IPs 13.39.123.174, 51.44.1.11
Redirect IPs 13.39.123.174, 51.44.1.11
Response IP 13.39.123.174
Found Yes
Hash 14869b9060c7a29775228389840cc53e89bb27d456681c37c8b8d40c1fd31521
SimHash f3bb526acde3

Groups

alexibot
apocalxexplorerbot
asterias
backdoorbot/1.0
black hole
blowfish/1.0
botalot
builtbottough
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
disco pump 3.1
dittospyder
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
foobot
harvest/1.5
hloader
httplib
humanlinks
infonavirobot
igentia
jennybot
kenjin spider
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lwp-trivial
lwp-trivial/1.34
mata hari
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
moget
moget/2.1
netants
netattache
netattache light 1.1
netmechanic
nicerspro
offline explorer
openfind
openfind data gathere
propowerbot/2.14
prowebwalker
psbot
queryn metasearch
repomonkey
repomonkey bait & tackle/v1.01
rma
sitesnagger
spankbot
spanner
superbot
superbot/2.6
suzuran
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webcopy
webenhancer
webmasterworldforumbot
webmirror
webreaper
websauger
website extractor
website quester
webster pro
webstripper
webstripper/2.02
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
winhttrack
www-collector-e
xenu
xenu's
xenu's link sleuth 1.1c
zeus
zeus 32297 webster pro v2.9 win32
httrack
httrack 3.0
turnitinbot
quepasacreep
grapeshot
sitecheck.internetseer.com
zealbot
msiecrawler
fetch
teleportpro
linko
microsoft.url.control
larbin
libwww
zyborg
download ninja

Rule Path
Disallow /

*

Rule Path
Disallow /click.php

Warnings

  • `noindex` is not a known field.