agezweho.com
robots.txt

Robots Exclusion Standard data for agezweho.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	agezweho.com
Base Domain	agezweho.com
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Couldn't connect to server.
Last Scan	2024-07-25T13:15:33+00:00
Next Scan	2024-10-23T13:15:33+00:00

Last Successful Scan

Scanned	2023-12-29T11:04:46+00:00
URL	http://agezweho.com/robots.txt
Domain IPs	103.82.171.8
Response IP	103.82.171.8
Found	Yes
Hash	f56b49534b0652cf25ebfc7ca418be55cbccee59cd1eb57d1f1917e95df763f6
SimHash	7e07c471e18b

Groups

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

megaindex.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

barkrowler

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

googlebot

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seokicks

Rule	Path
Disallow	/

Rule

Path

Disallow

serpstatbot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seekport

Rule	Path
Disallow	/

Rule

Path

Disallow

trendictionbot

Rule	Path
Disallow	/

Rule

Path

Disallow

aihitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

yahoo

Rule	Path
Disallow	/

Rule

Path

Disallow

zoominfobot

Rule	Path
Disallow	/

Rule

Path

Disallow

facebookexternalhit

Rule	Path
Disallow	/

Rule

Path

Disallow

coccocbot

Rule	Path
Disallow	/

Rule

Path

Disallow

seznambot

Rule	Path
Disallow	/

Rule

Path

Disallow

pinterestbot

Rule	Path
Disallow	/

Rule

Path

Disallow

vuhuvbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mojeekbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru

Rule	Path
Disallow	/

Rule

Path

Disallow

slurp

Rule	Path
Disallow	/

Rule

Path

Disallow

bytespider

Rule	Path
Disallow	/

Rule

Path

Disallow

yisouspider

Rule	Path
Disallow	/

Rule

Path

Disallow

msnbot

Rule	Path
Disallow	/

Rule

Path

Disallow

toutiaospider

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

feeddemon

Rule	Path
Disallow	/

Rule

Path

Disallow

bot/0.1 (bot for jce)

Rule	Path
Disallow	/

Rule

Path

Disallow

crawldaddy

Rule	Path
Disallow	/

Rule

Path

Disallow

java

Rule	Path
Disallow	/

Rule

Path

Disallow

jullo

Rule	Path
Disallow	/

Rule

Path

Disallow

feedly

Rule	Path
Disallow	/

Rule

Path

Disallow

universalfeedparser

Rule	Path
Disallow	/

Rule

Path

Disallow

apachebench

Rule	Path
Disallow	/

Rule

Path

Disallow

swiftbot

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Disallow	/h_m_w/
Disallow

Rule

Path

Disallow

/h_m_w/

Disallow

Other Records

Field	Value
sitemap	http://agezweho.com/sitemap.xml

Field

Value

sitemap

http://agezweho.com/sitemap.xml

agezweho.comrobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

ahrefsbot

semrushbot

dotbot

mj12bot

megaindex.ru

yandexbot

barkrowler

blexbot

googlebot

bingbot

seokicks

serpstatbot

petalbot

seekport

trendictionbot

aihitbot

yahoo

zoominfobot

facebookexternalhit

coccocbot

seznambot

pinterestbot

vuhuvbot

mojeekbot

mail.ru

slurp

bytespider

yisouspider

msnbot

toutiaospider

petalbot

feeddemon

bot/0.1 (bot for jce)

crawldaddy

java

jullo

feedly

universalfeedparser

apachebench

swiftbot

*

Other Records

agezweho.com
robots.txt