ezglot.com
robots.txt

Robots Exclusion Standard data for ezglot.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	ezglot.com
Base Domain	ezglot.com
Scan Status	Ok
Last Scan	2024-09-27T08:05:08+00:00
Next Scan	2024-10-27T08:05:08+00:00

Last Scan

Scanned	2024-09-27T08:05:08+00:00
URL	https://ezglot.com/robots.txt
Domain IPs	95.216.162.251
Response IP	95.216.162.251
Found	Yes
Hash	c042362fdf117dea9cf23ff9449fa3cc36c010a6f0c442625e629059d4d77d54
SimHash	2fdf1863e637

Groups

*
google

Rule	Path
Allow	/

Rule

Path

Allow

Other Records

Field	Value
crawl-delay	1

Field

Value

crawl-delay

googlebot

Rule	Path
Allow	/

Rule

Path

Allow

Other Records

Field	Value
crawl-delay	1

Field

Value

crawl-delay

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

bing

Rule	Path
Disallow	/

Rule

Path

Disallow

bingbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msn

Rule	Path
Allow	/

Rule

Path

Allow

Other Records

Field	Value
crawl-delay	5

Field

Value

crawl-delay

msnbot

Rule	Path
Allow	/

Rule

Path

Allow

Other Records

Field	Value
crawl-delay	5

Field

Value

crawl-delay

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

israbot

Rule	Path
Disallow	/

Rule

Path

Disallow

orthogaffe

Rule	Path
Disallow	/

Rule

Path

Disallow

ubicrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

doc

Rule	Path
Disallow	/

Rule

Path

Disallow

zao

Rule	Path
Disallow	/

Rule

Path

Disallow

sitecheck.internetseer.com

Rule	Path
Disallow	/

Rule

Path

Disallow

zealbot

Rule	Path
Disallow	/

Rule

Path

Disallow

msiecrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

sitesnagger

Rule	Path
Disallow	/

Rule

Path

Disallow

webstripper

Rule	Path
Disallow	/

Rule

Path

Disallow

webcopier

Rule	Path
Disallow	/

Rule

Path

Disallow

fetch

Rule	Path
Disallow	/

Rule

Path

Disallow

offline explorer

Rule	Path
Disallow	/

Rule

Path

Disallow

teleport

Rule	Path
Disallow	/

Rule

Path

Disallow

teleportpro

Rule	Path
Disallow	/

Rule

Path

Disallow

webzip

Rule	Path
Disallow	/

Rule

Path

Disallow

linko

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack

Rule	Path
Disallow	/

Rule

Path

Disallow

microsoft.url.control

Rule	Path
Disallow	/

Rule

Path

Disallow

xenu

Rule	Path
Disallow	/

Rule

Path

Disallow

larbin

Rule	Path
Disallow	/

Rule

Path

Disallow

libwww

Rule	Path
Disallow	/

Rule

Path

Disallow

zyborg

Rule	Path
Disallow	/

Rule

Path

Disallow

download ninja

Rule	Path
Disallow	/

Rule

Path

Disallow

fast

Rule	Path
Disallow	/

Rule

Path

Disallow

wget

Rule	Path
Disallow	/

Rule

Path

Disallow

grub-client

Rule	Path
Disallow	/

Rule

Path

Disallow

k2spider

Rule	Path
Disallow	/

Rule

Path

Disallow

npbot

Rule	Path
Disallow	/

Rule

Path

Disallow

webreaper

Rule	Path
Disallow	/

Rule

Path

Disallow

gptbot

Rule	Path
Disallow	/

Rule

Path

Disallow

chatgpt-user

Rule	Path
Disallow	/

Rule

Path

Disallow

*

Rule	Path
Allow	/

Rule

Path

Allow

Comments

Crawl-delay: 5
Crawl-delay: 5
Crawl-delay: 5
Crawl-delay: 5

Warnings

`clean-param` is not a known field.

ezglot.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*google

Other Records

googlebot

Other Records

yandex

yandexbot

bing

bingbot

msn

Other Records

msnbot

Other Records

mj12bot

israbot

orthogaffe

ubicrawler

doc

zao

sitecheck.internetseer.com

zealbot

msiecrawler

sitesnagger

webstripper

webcopier

fetch

offline explorer

teleport

teleportpro

webzip

linko

httrack

microsoft.url.control

xenu

larbin

libwww

zyborg

download ninja

fast

wget

grub-client

k2spider

npbot

webreaper

gptbot

chatgpt-user

*

Comments

Warnings

ezglot.com
robots.txt

*
google