lefranc.net
robots.txt
Robots Exclusion Standard data for lefranc.net
Resource Scan
Scan Details
| Site Domain | lefranc.net |
| Base Domain | lefranc.net |
| Scan Status | Ok |
| Last Scan | 2025-11-05T18:48:16+00:00 |
| Next Scan | 2025-12-05T18:48:16+00:00 |
Last Scan
| Scanned | 2025-11-05T18:48:16+00:00 |
| URL | https://www.lefranc.net/robots.txt |
| Domain IPs | 51.83.3.51 |
| Response IP | 51.83.3.51 |
| Found | Yes |
| Hash | 9050aae093f06987ba10d0e3c64b8633cc17e8ab145754c0bf541f58c6c10749 |
| SimHash | 727fd2500f38 |
Groups
*
| Rule | Path |
|---|---|
| Disallow |
admantx
blexbot
boitho.com-dc
cazoodlebot
converacrawler
discobot
dotbot
echoping
exabot
fasterfox
genieo
gigabot
grapeshot
heritrix
huaweisymantecspider
ia_archiver
ichiro
irlbot
jakarta
jetbot
kalooga
lexxebot
magpie-crawler
mlbot
msiecrawler
naverbot
ocelli
penthesilea
petalbot
phpdig
proximic
quepasacreep
scoutjet
searchdaimon.com-dc
semvisubot
serpstatbot
shopwiki
snapbot
turnitinbot
twengabot
twiceler
wget
woozweb-monitoring
woriobot
yacybit
yacybot
yeti
yodaobot
zyborg
semrushbot
| Rule | Path |
|---|---|
| Disallow | / |