myglit.com
robots.txt

Robots Exclusion Standard data for myglit.com

Resource Scan

Scan Details

Site Domain myglit.com
Base Domain myglit.com
Scan Status Ok
Last Scan2024-09-20T18:30:47+00:00
Next Scan 2024-09-27T18:30:47+00:00

Last Scan

Scanned2024-09-20T18:30:47+00:00
URL https://myglit.com/robots.txt
Domain IPs 13.35.18.126, 13.35.18.26, 13.35.18.75, 13.35.18.87
Response IP 13.35.18.26
Found Yes
Hash 7bcc6fbab0d3fb0e3ec4818d55b86fd553b5c41d9d3faea46368682246e54995
SimHash 00141341d49b

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

yahoo! slurp

Rule Path
Disallow

duckduckgo-instantanswer-bot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandexbot

Rule Path
Disallow

applebot

Rule Path
Disallow

facebook external hit

Rule Path
Disallow

twitterbot

Rule Path
Disallow

linkedinbot

Rule Path
Disallow

pinterest

Rule Path
Disallow

slackbot

Rule Path
Disallow

discordbot

Rule Path
Disallow

whatsapp

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

adsbot-google

Rule Path
Disallow

mj12bot

Rule Path
Disallow

exabot

Rule Path
Disallow

dotbot

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

semrushbot

Rule Path
Disallow

sogou spider

Rule Path
Disallow