ligloo.fr
robots.txt

Robots Exclusion Standard data for ligloo.fr

Archived Snapshots

Resource Scan

Scan Details

Site Domain	ligloo.fr
Base Domain	ligloo.fr
Scan Status	Ok
Last Scan	5/18/2025, 1:29:10 AM
Next Scan	5/25/2025, 1:29:10 AM

Last Scan

Scanned	5/18/2025, 1:29:10 AM
URL	https://ligloo.fr/robots.txt
Redirect	https://www.ligloo.fr/robots.txt
Redirect Domain	www.ligloo.fr
Redirect Base	ligloo.fr
Domain IPs	104.21.37.246, 172.67.216.113, 2606:4700:3033::6815:25f6, 2606:4700:3033::ac43:d871
Redirect IPs	104.21.37.246, 172.67.216.113, 2606:4700:3033::6815:25f6, 2606:4700:3033::ac43:d871
Response IP	104.21.37.246
Found	Yes
Hash	bf11c85c1b86132cc6253265101d1daa1e76922bce6aa8c253c530817a431a4e
SimHash	9157794aee21

Groups

*

Rule	Path
Disallow	/tools/
Disallow	/extlink/
Disallow	/tag/

Rule

Path

Disallow

/tools/

Disallow

/extlink/

Disallow

/tag/

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

trovitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

proximic

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

nutch

Rule	Path
Disallow	/

Rule

Path

Disallow

ubicrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

doc

Rule	Path
Disallow	/

Rule

Path

Disallow

zao

Rule	Path
Disallow	/

Rule

Path

Disallow

sitecheck.internetseer.com

Rule	Path
Disallow	/

Rule

Path

Disallow

zealbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msiecrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

sitesnagger

Rule	Path
Disallow	/

Rule

Path

Disallow

webstripper

Rule	Path
Disallow	/

Rule

Path

Disallow

webcopier

Rule	Path
Disallow	/

Rule

Path

Disallow

fetch

Rule	Path
Disallow	/

Rule

Path

Disallow

offline explorer

Rule	Path
Disallow	/

Rule

Path

Disallow

teleport

Rule	Path
Disallow	/

Rule

Path

Disallow

teleportpro

Rule	Path
Disallow	/

Rule

Path

Disallow

webzip

Rule	Path
Disallow	/

Rule

Path

Disallow

linko

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack

Rule	Path
Disallow	/

Rule

Path

Disallow

microsoft.url.control

Rule	Path
Disallow	/

Rule

Path

Disallow

xenu

Rule	Path
Disallow	/

Rule

Path

Disallow

larbin

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww

Rule	Path
Disallow	/

Rule

Path

Disallow

zyborg

Rule	Path
Disallow	/

Rule

Path

Disallow

download ninja

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow

Rule

Path

Disallow

mediapartners

Rule	Path
Allow	/

Rule

Path

Allow

mediapartners-google

Rule	Path
Allow	/

Rule

Path

Allow

adsbot-google

Rule	Path
Allow	/

Rule

Path

Allow

wget

Rule	Path
Disallow	/

Rule

Path

Disallow

grub-client

Rule	Path
Disallow	/

Rule

Path

Disallow

k2spider

Rule	Path
Disallow	/

Rule

Path

Disallow

npbot

Rule	Path
Disallow	/

Rule

Path

Disallow

webreaper

Rule	Path
Disallow	/

Rule

Path

Disallow

velenpublicwebcrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

rogerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

getintent

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex

Rule	Path
Disallow	/

Rule

Path

Disallow

ligloo.frrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

ahrefsbot

trovitbot

proximic

mj12bot

scrapy

nutch

ubicrawler

doc

zao

sitecheck.internetseer.com

zealbot

msiecrawler

sitesnagger

webstripper

webcopier

fetch

offline explorer

teleport

teleportpro

webzip

linko

httrack

microsoft.url.control

xenu

larbin

libwww

zyborg

download ninja

mj12bot

mediapartners

mediapartners-google

adsbot-google

wget

grub-client

k2spider

npbot

webreaper

velenpublicwebcrawler

dotbot

rogerbot

semrushbot-sa

semrushbot

getintent

megaindex

ligloo.fr
robots.txt