Log In Sign Up

fr.youglish.com
robots.txt

Robots Exclusion Standard data for fr.youglish.com

Resource Scan

Scan Details

Site Domain fr.youglish.com
Base Domain youglish.com
Scan Status Ok
Last Scan2024-11-14T07:51:39+00:00
Next Scan 2024-11-21T07:51:39+00:00

Last Scan

Scanned2024-11-14T07:51:39+00:00
URL https://fr.youglish.com/robots.txt
Domain IPs 104.26.10.232, 104.26.11.232, 172.67.69.77, 2606:4700:20::681a:ae8, 2606:4700:20::681a:be8, 2606:4700:20::ac43:454d
Response IP 104.26.11.232
Found Yes
Hash 2b703ab70df849347452a88e428dc07d56883746e9270d1930ff757d70e49cab
SimHash eb2e6b53e631

Groups

*

Rule Path
Disallow /fetch.jsp
Disallow /fetchcap.jsp
Disallow /translation/
Disallow /access.jsp
Disallow /payment.jsp
Disallow /api/v1
Disallow /lesson/

sitecheckerbotcrawler

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

amazonadbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mojeekbot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

serendeputybot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

ias_crawler

Rule Path
Disallow /

gowikibot

Rule Path
Disallow /

domainstatsbot

Rule Path
Disallow /

yamanalab-robot

Rule Path
Disallow /

extlinksbot

Rule Path
Disallow /

spbot

Rule Path
Disallow /

siteexplorer

Rule Path
Disallow /

mappy

Rule Path
Disallow /

jooblebot

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

cxensebot

Rule Path
Disallow /

jamesbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yisouspider

Rule Path
Disallow /

proximic

Rule Path
Disallow /

ezooms

Rule Path
Disallow /

sistrix

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

linkedinbot

Rule Path
Disallow /

deusu

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

netseer

Rule Path
Disallow /

smtbot

Rule Path
Disallow /

clickagy intelligence bot

Rule Path
Disallow /

mediatoolkitbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

netestate

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

integromedb

Rule Path
Disallow /

izsearch.com

Rule Path
Disallow /

spambot crawler

Rule Path
Disallow /

izsearch.com

Rule Path
Disallow /

domain reanimator bot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

surdotlybot

Rule Path
Disallow /

yacybot

Rule Path
Disallow /

experibot_v1

Rule Path
Disallow /

wotbox

Rule Path
Disallow /

safednsbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

linguee

Rule Path
Disallow /
Back to top

Warnings

  • 4 invalid lines.
Back to top