Log In Sign Up

weddo.info
robots.txt

Robots Exclusion Standard data for weddo.info

Resource Scan

Scan Details

Site Domain weddo.info
Base Domain weddo.info
Scan Status Ok
Last Scan2024-09-20T13:13:41+00:00
Next Scan 2024-09-27T13:13:41+00:00

Last Scan

Scanned2024-09-20T13:13:41+00:00
URL https://weddo.info/robots.txt
Domain IPs 89.233.105.238
Response IP 89.233.105.238
Found Yes
Hash d9c7f748e3d92944da681cc895b745e4b24ac390e7d3ef710a80396b08bc1e84
SimHash 27907700c9d9

Groups

googlebot

Rule Path
Disallow

googlebot-image

Rule Path
Disallow

googlebot-mobile

Rule Path
Disallow

msnbot

Rule Path
Disallow

slurp

Rule Path
Disallow

teoma

Rule Path
Disallow

gigabot

Rule Path
Disallow

robozilla

Rule Path
Disallow

nutch

Rule Path
Disallow

ia_archiver

Rule Path
Disallow

baiduspider

Rule Path
Disallow

naverbot

Rule Path
Disallow

lcc

Rule Path
Disallow

adidxbot

Rule Path
Disallow

serpstatbot

Rule Path
Disallow

scooperbot

Rule Path
Disallow

feedburner

Rule Path
Disallow

uptimerobot

Rule Path
Disallow

updownerbot

Rule Path
Disallow

statuscake

Rule Path
Disallow

netcraft

Rule Path
Disallow

facebookexternalhit

Rule Path
Disallow

twitterbot/1.0

Rule Path
Disallow

twitterbot/1.1

Rule Path
Disallow

twitterbot/2.0

Rule Path
Disallow

twitterbot/3.0

Rule Path
Disallow

twitterbot/3.1

Rule Path
Disallow

twitterbot/3.2

Rule Path
Disallow

twitterbot/3.3

Rule Path
Disallow

twitterbot/3.4

Rule Path
Disallow

twitterbot/3.5

Rule Path
Disallow

baiduspider+(+http://www.baidu.com/search/spider.htm)

Rule Path
Disallow

ahrefsbot/7.0

Rule Path
Disallow

adsbot-google-mobile

Rule Path
Disallow

daum/4.1

Rule Path
Disallow

edisterbot

Rule Path
Disallow

holmes

Rule Path
Disallow

icc-crawler

Rule Path
Disallow

infopath

Rule Path
Disallow

k2spider

Rule Path
Disallow

lipsper

Rule Path
Disallow

microsoft url control

Rule Path
Disallow

msiecrawler

Rule Path
Disallow

ncbot

Rule Path
Disallow

parsijoo

Rule Path
Disallow

php

Rule Path
Disallow

seo

Rule Path
Disallow

seodiver

Rule Path
Disallow

seoscanners

Rule Path
Disallow

sputnikbot

Rule Path
Disallow

te

Rule Path
Disallow

trendictionbot

Rule Path
Disallow

ucweb

Rule Path
Disallow

wavesentinel

Rule Path
Disallow

woko

Rule Path
Disallow

wordpress

Rule Path
Disallow

yacybot

Rule Path
Disallow

yahoo

Rule Path
Disallow

daum

Rule Path
Disallow

yeti

Rule Path
Disallow

yahoo-mmcrawler

Rule Path
Disallow

psbot

Rule Path
Disallow

yahoo-blogs/v3.9

Rule Path
Disallow

yandex

Rule Path
Disallow

bingbot

Rule Path
Disallow

bingpreview

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

baiduspider

Rule Path
Disallow

yandeximages

Rule Path
Disallow

mediapartners-google

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow

semrushbot

Rule Path
Disallow

mj12bot

Rule Path
Disallow

semrushbot-sa

Rule Path
Disallow

seznambot

Rule Path
Disallow

exabot

Rule Path
Disallow

facebot

Rule Path
Disallow

twitterbot

Rule Path
Disallow

linkedinbot

Rule Path
Disallow

discordbot

Rule Path
Disallow

pinterest

Rule Path
Disallow

whatsapp

Rule Path
Disallow

telegrambot

Rule Path
Disallow

snapchat

Rule Path
Disallow

instagram

Rule Path
Disallow

facebook

Rule Path
Disallow

duckduckgo-favicons-bot

Rule Path
Disallow

duckduckgo-lighthouse

Rule Path
Disallow

bingpreview

Rule Path
Disallow

applebot

Rule Path
Disallow

adsbot-google-mobile-apps

Rule Path
Disallow

yandexbot

Rule Path
Disallow

dotbot

Rule Path
Disallow

ccbot

Rule Path
Disallow

yahoo! slurp china

Rule Path
Disallow

yahoo! slurp

Rule Path
Disallow

shopwiki

Rule Path
Disallow

seznambot

Rule Path
Disallow

addthis

Rule Path
Disallow

blexbot

Rule Path
Disallow

bubing

Rule Path
Disallow

crawl

Rule Path
Disallow

daumoa

Rule Path
Disallow

fatbitbot

Rule Path
Disallow

findxbot

Rule Path
Disallow

frcrawler

Rule Path
Disallow

garlikcrawler

Rule Path
Disallow

grub-client

Rule Path
Disallow

ips-agent

Rule Path
Disallow

jikespider

Rule Path
Disallow

linkedinbot

Rule Path
Disallow

ltx71

Rule Path
Disallow

megaindex

Rule Path
Disallow

nekstbot

Rule Path
Disallow

nerdbynature.bot

Rule Path
Disallow

netestate ne crawler

Rule Path
Disallow

newsgator

Rule Path
Disallow

openwebspider

Rule Path
Disallow

paperlibot

Rule Path
Disallow

powerbot

Rule Path
Disallow

queryseekerspider

Rule Path
Disallow

quora link preview

Rule Path
Disallow

rogerbot

Rule Path
Disallow

scoutjet

Rule Path
Disallow

shopwiki

Rule Path
Disallow

smtbot

Rule Path
Disallow

solomonobot

Rule Path
Disallow

surveybot

Rule Path
Disallow

taringa bot

Rule Path
Disallow

turnitinbot

Rule Path
Disallow

unwindfetchor

Rule Path
Disallow

vortex

Rule Path
Disallow

vyu2

Rule Path
Disallow

wbsearchbot

Rule Path
Disallow

wesee:search

Rule Path
Disallow

wotbox

Rule Path
Disallow

xenu's

Rule Path
Disallow

yak

Rule Path
Disallow

youdaobot

Rule Path
Disallow

yrspider

Rule Path
Disallow

zebot

Rule Path
Disallow

zoominfobot

Rule Path
Disallow

zumbot

Rule Path
Disallow

*

Rule Path
Disallow /admin/
Disallow /cgi-bin/
Back to top

Comments

  • robots.txt generated by dgoo.in
Back to top

Warnings

  • 2 invalid lines.
Back to top