info-blog.org
robots.txt

Robots Exclusion Standard data for info-blog.org

Archived Snapshots

Resource Scan

Scan Details

Site Domain	info-blog.org
Base Domain	info-blog.org
Scan Status	Ok
Last Scan	2024-11-12T07:28:47+00:00
Next Scan	2024-11-19T07:28:47+00:00

Last Scan

Scanned	2024-11-12T07:28:47+00:00
URL	https://info-blog.org/robots.txt
Domain IPs	104.21.4.48, 172.67.131.170, 2606:4700:3032::6815:430, 2606:4700:3035::ac43:83aa
Response IP	104.21.4.48
Found	Yes
Hash	72a4ddd8af8a5931c23ec1c8e44563a9b43962068cb61250ca5898bc394ebcf2
SimHash	40bc4b8accb4

Groups

*

Rule	Path
Disallow	/wp-admin/
Allow	/wp-admin/admin-ajax.php
Disallow	/wp-includes/
Disallow	/readme.html
Disallow	/license.txt
Disallow	/xmlrpc.php
Disallow	/wp-login.php
Disallow	/wp-register.php
Disallow	/?
Disallow	/*?%2F
Disallow	/~
Disallow	/*~/

Rule

Path

Disallow

/wp-admin/

Allow

/wp-admin/admin-ajax.php

Disallow

/wp-includes/

Disallow

/readme.html

Disallow

/license.txt

Disallow

/xmlrpc.php

Disallow

/wp-login.php

Disallow

/wp-register.php

Disallow

/*?*

Disallow

/*?%2F

Disallow

/*~*

Disallow

/*~/

googlebot-image

Rule	Path
Allow	/wp-content/uploads/

Rule

Path

Allow

/wp-content/uploads/

mediapartners-google

Rule	Path
Allow	/

Rule

Path

Allow

adsbot-google

Rule	Path
Allow	/

Rule

Path

Allow

adsbot-google-mobile

Rule	Path
Allow	/

Rule

Path

Allow

bingbot

Rule	Path
Allow	/

Rule

Path

Allow

msnbot

Rule	Path
Allow	/

Rule

Path

Allow

msnbot-media

Rule	Path
Allow	/wp-content/uploads/

Rule

Path

Allow

/wp-content/uploads/

applebot

Rule	Path
Allow	/

Rule

Path

Allow

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

yandeximages

Rule	Path
Disallow	/wp-content/uploads/

Rule

Path

Disallow

/wp-content/uploads/

slurp

Rule	Path
Allow	/

Rule

Path

Allow

duckduckbot

Rule	Path
Allow	/

Rule

Path

Allow

qwantify

Rule	Path
Allow	/

Rule

Path

Allow

baiduspider

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider-video

Rule	Path
Disallow	/

Rule

Path

Disallow

baiduspider-image

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider

Rule	Path
Disallow	/

Rule

Path

Disallow

sosospider2.0

Rule	Path
Disallow	/

Rule

Path

Disallow

yodao

Rule	Path
Disallow	/

Rule

Path

Disallow

youdao

Rule	Path
Disallow	/

Rule

Path

Disallow

youdaobot

Rule	Path
Disallow	/

Rule

Path

Disallow

youdaobot1.0

Rule	Path
Disallow	/
Disallow	/feed/
Disallow	/feed/%24/
Disallow	/comments/feed/
Disallow	/trackback/
Disallow	//?author=
Disallow	//author/
Disallow	/author*
Disallow	/author/
Disallow	/*/comments%24/
Disallow	/*/feed/
Disallow	/*/feed%24/
Disallow	/*/trackback/
Disallow	/*/trackback%24/
Disallow	/?feed=%2F
Disallow	/wp-comments/
Disallow	/wp-feed/
Disallow	/wp-trackback/
Disallow	/*/replytocom%3D/

Rule

Path

Disallow

/feed/

Disallow

/feed/%24/

Disallow

/comments/feed/

Disallow

/trackback/

Disallow

/*/?author=*

Disallow

/*/author/*

Disallow

/author*

Disallow

/author/

Disallow

/*/comments%24/

Disallow

/*/feed/

Disallow

/*/feed%24/

Disallow

/*/trackback/

Disallow

/*/trackback%24/

Disallow

/?feed=%2F

Disallow

/wp-comments/

Disallow

/wp-feed/

Disallow

/wp-trackback/

Disallow

/*/replytocom%3D/

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

giftghostbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seznam

Rule	Path
Disallow	/

Rule

Path

Disallow

paperlibot

Rule	Path
Disallow	/

Rule

Path

Disallow

genieo

Rule	Path
Disallow	/

Rule

Path

Disallow

dataprovider6.101

Rule	Path
Disallow	/

Rule

Path

Disallow

dataprovidersiteexplorer

Rule	Path
Disallow	/

Rule

Path

Disallow

dazoobot1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

diffbot

Rule	Path
Disallow	/

Rule

Path

Disallow

domainstatsbot1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot1.1

Rule	Path
Disallow	/

Rule

Path

Disallow

dubaiindex

Rule	Path
Disallow	/

Rule

Path

Disallow

ecommercebot

Rule	Path
Disallow	/

Rule

Path

Disallow

expertsearchspider

Rule	Path
Disallow	/

Rule

Path

Disallow

feedbin

Rule	Path
Disallow	/

Rule

Path

Disallow

fetch2.0a

Rule	Path
Disallow	/

Rule

Path

Disallow

ffbot1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot

Rule	Path
Allow	/

Rule

Path

Allow

focusbot1.1

Rule	Path
Disallow	/

Rule

Path

Disallow

huaweisymantecspider

Rule	Path
Disallow	/

Rule

Path

Disallow

huaweisymantecspider1.0

Rule	Path
Disallow	/

Rule

Path

Disallow

jobdiggerspider

Rule	Path
Disallow	/

Rule

Path

Disallow

lemurwebcrawler

Rule

Path

Disallow

lipperheylinkexplorer

Rule

Path

Disallow

lssrocketcrawler1.0

Rule

Path

Disallow

lyt.srv1.5

Rule

Path

Disallow

miadev0.0.1

Rule

Path

Disallow

najdi.si3.1

Rule

Path

Disallow

bountiibot

Rule

Path

Disallow

experibot_v1

Rule

Path

Disallow

bixocrawler

Rule

Path

Disallow

bixocrawler testcrawler

Rule

Path

Disallow

crawler4j

Rule

Path

Disallow

crowsnest0.5

Rule

Path

Disallow

cukbot

Rule

Path

Disallow

dataprovider6.92

Rule

Path

Disallow

dblbot1.0

Rule

Path

Disallow

diffbot0.1

Rule

Path

Disallow

digg deeperv1

Rule

Path

Disallow

discobot1.0

Rule

Path

Disallow

discobot1.1

Rule

Path

Disallow

discobot2.0

Rule

Path

Disallow

discoverybot2.0

Rule

Path

Disallow

dlvr.it1.0

Rule

Path

Disallow

drupact0.7

Rule

Path

Disallow

ezooms1.0

Rule

Path

Disallow

fastbot crawler beta 2.0

Rule

Path

Disallow

fastbot crawler beta 4.0

Rule

Path

Disallow

feedly social

Rule

Path

Disallow

feedly1.0

Rule

Path

Disallow

feedlybot1.0

Rule

Path

Disallow

feedspot

Rule

Path

Disallow

feedspotbot1.0

Rule

Path

Disallow

clickagy intelligence bot v2

Rule

Path

Disallow

classbot

Rule

Path

Disallow

cispa vulnerability notification

Rule

Path

Disallow

cirrusexplorer1.1

Rule

Path

Disallow

checksemnutch-1.10

Rule

Path

Disallow

catchbot5.0

Rule

Path

Disallow

catchbot3.0

Rule

Path

Disallow

catchbot2.0

Rule

Path

Disallow

catchbot1.0

Rule

Path

Disallow

camontspider1.0

Rule

Path

Disallow

buzzbot1.0

Rule

Path

Disallow

buzzbot

Rule

Path

Disallow

businessseek.biz_spider

Rule

Path

Disallow

bubing

Rule

Path

Disallow

nail

Rule

Path

Disallow

fyberspider1.3

Rule

Path

Disallow

findlinks1.1.6-beta5

Rule

Path

Disallow

g2reader-bot1.0

Rule

Path

Disallow

findlinks1.1.6-beta6

Rule

Path

Disallow

findlinks2.0

Rule

Path

Disallow

findlinks2.0.1

Rule

Path

Disallow

findlinks2.0.2

Rule

Path

Disallow

findlinks2.0.4

Rule

Path

Disallow

findlinks2.0.5

Rule

Path

Disallow

findlinks2.0.9

Rule

Path

Disallow

findlinks2.1

Rule

Path

Disallow

findlinks2.1.5

Rule

Path

Disallow

findlinks2.1.3

Rule

Path

Disallow

findlinks2.2

Rule

Path

Disallow

findlinks2.5

Rule

Path

Disallow

findlinks2.6

Rule

Path

Disallow

findlinks1.0

Rule

Path

Disallow

findlinks1.1.3-beta8

Rule

Path

Disallow

findlinks1.1.3-beta9

Rule

Path

Disallow

findlinks1.1.4-beta7

Rule

Path

Disallow

findlinks1.1.6-beta1

Rule

Path

Disallow

findlinks1.1.6-beta1 yacy

Rule

Path

Disallow

findlinks1.1.6-beta2

Rule

Path

Disallow

findlinks1.1.6-beta3

Rule

Path

Disallow

findlinks1.1.6-beta4

Rule

Path

Disallow

bixo

Rule

Path

Disallow

bixolabs1.0

Rule

Path

Disallow

crawlera1.10.2

Rule

Path

Disallow

dataprovider site explorer

Rule

Path

Disallow

ahrefsbot

Rule

Path

Disallow

alexibot

Rule

Path

Disallow

mj12bot

Rule

Path

Disallow

surveybot

Rule

Path

Disallow

xenus

Rule

Path

Disallow

xenus link sleuth 1.1c

Rule

Path

Disallow

rogerbot

Rule

Path

Disallow

/cart/

Disallow

/checkout/

Disallow

/my-account/

Disallow

/*?orderby=price%2F

Disallow

/*?orderby=rating%2F

Disallow

/*?orderby=date%2F

Disallow

/*?orderby=price-desc%2F

Disallow

/*?orderby=popularity%2F

Disallow

/*?filter%2F

Disallow

/*add-to-cart%3D*

Disallow

/search/

Disallow

/*?s=*

Disallow

/*?p=*

Disallow

/*%26p%3D*

Disallow

/*%26preview%3D*

facebookexternalhit1.0

Rule

Path

Allow

facebookexternalhit1.1

Rule

Path

Allow

facebookplatform1.0

Rule

Path

Allow

facebot1.0

Rule

Path

Allow

visionutils0.2

Rule

Path

Allow

datagnionbot

Rule

Path

Allow

twitterbot

Rule

Path

Allow

linkedinbot1.0

Rule

Path

Allow

pinterest0.1

Rule

Path

Allow

pinterest0.2

Rule

Path

Allow

/ads.txt

Allow

/app-ads.txt

coronaviruscovid-19

Rule

Path

Disallow

Other Records

Field

Value

sitemap

https://info-blog.org/sitemap.xml

sitemap

https://info-blog.org/sitemap.rss

Warnings

6 invalid lines.

info-blog.orgrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

googlebot-image

mediapartners-google

adsbot-google

adsbot-google-mobile

bingbot

msnbot

msnbot-media

applebot

yandex

yandeximages

slurp

duckduckbot

qwantify

baiduspider

baiduspider2.0

baiduspider-video

baiduspider-image

sogou spider

sogou web spider

sosospider

sosospider2.0

yodao

youdao

youdaobot

youdaobot1.0

dotbot

giftghostbot

seznam

paperlibot

genieo

dataprovider6.101

dataprovidersiteexplorer

dazoobot1.0

diffbot

domainstatsbot1.0

dotbot1.1

dubaiindex

ecommercebot

expertsearchspider

feedbin

fetch2.0a

ffbot1.0

googlebot

focusbot1.1

huaweisymantecspider

huaweisymantecspider1.0

jobdiggerspider

lemurwebcrawler

lipperheylinkexplorer

lssrocketcrawler1.0

lyt.srv1.5

miadev0.0.1

najdi.si3.1

bountiibot

experibot_v1

bixocrawler

bixocrawler testcrawler

crawler4j

crowsnest0.5

cukbot

dataprovider6.92

dblbot1.0

diffbot0.1

digg deeperv1

discobot1.0

discobot1.1

discobot2.0

discoverybot2.0

dlvr.it1.0

drupact0.7

ezooms1.0

fastbot crawler beta 2.0

fastbot crawler beta 4.0

feedly social

info-blog.org
robots.txt