junior.universalis.fr
robots.txt

Robots Exclusion Standard data for junior.universalis.fr

Resource Scan

Scan Details

Site Domain junior.universalis.fr
Base Domain universalis.fr
Scan Status Ok
Last Scan2024-09-24T03:35:28+00:00
Next Scan 2024-10-08T03:35:28+00:00

Last Scan

Scanned2024-09-24T03:35:28+00:00
URL https://junior.universalis.fr/robots.txt
Domain IPs 137.74.25.45
Response IP 137.74.25.45
Found Yes
Hash 2fb9d8c9638c04e1d9a55d7082b8ab0b498da14e98d091e533f6b37212d71a1b
SimHash b257e280c1e2

Groups

psbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mlbot

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

soni

Rule Path
Disallow /

sogou

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

ichiro

Rule Path
Disallow /

docomo

Rule Path
Disallow /

snapbot

Rule Path
Disallow /

ssearch_bot

Rule Path
Disallow /

vikspider

Rule Path
Disallow /

vik-robot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

businessdbbot

Rule Path
Disallow /

happyfunbot

Rule Path
Disallow /

jyxobot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

cityreview

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

mystbot

Rule Path
Disallow /

vik-robot

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ocelli

Rule Path
Disallow /

yeti

Rule Path
Disallow /

speedy

Rule Path
Disallow /

exabot

Rule Path
Disallow /

sitebot

Rule Path
Disallow /

comodospider

Rule Path
Disallow /

ayna

Rule Path
Disallow /

purebot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

discobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

*

Rule Path
Disallow /identification/
Disallow /typo3/
Disallow /uploads/
Disallow /recherche/
Disallow /atlas/
Disallow /datapays/
Disallow /evenement/
Disallow /chronologie/
Disallow /dictionnaire/
Disallow /carte-mentale/
Disallow /encyclopedie/carte-mentale/
Disallow /mobile/*
Disallow /typo3temp/tx_staticfilecache/
Disallow /1/
Disallow /media/

Warnings

  • 4 invalid lines.