mcpe.kalvlad1994.ru
robots.txt

Robots Exclusion Standard data for mcpe.kalvlad1994.ru

Archived Snapshots

Resource Scan

Scan Details

Site Domain	mcpe.kalvlad1994.ru
Base Domain	kalvlad1994.ru
Scan Status	Failed
Failure Stage	Fetching resource.
Failure Reason	Couldn't connect to server.
Last Scan	2024-10-27T23:47:36+00:00
Next Scan	2025-01-25T23:47:36+00:00

Last Successful Scan

Scanned	2022-12-10T21:12:03+00:00
URL	http://mcpe.kalvlad1994.ru/robots.txt
Domain IPs	15.197.130.221
Response IP	15.197.130.221
Found	Yes
Hash	81150fed4cd6b900092954012f0a8181687ab60105f4ff82e33b6f19277123f6
SimHash	64a75840449a

Groups

googlebot

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

baiduspider

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

yandexbot

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

ichiro

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

sogou spider

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

sosospider

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

youdaobot

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

yetibot

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

bingbot

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

Other Records

Field	Value
crawl-delay	2

Field

Value

crawl-delay

yahoo! slurp

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

Other Records

Field	Value
crawl-delay	2

Field

Value

crawl-delay

rdfbot

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

seznambot

Rule	Path
Disallow	/?*

Rule

Path

Disallow

/?*

ia_archiver

Rule	Path
Disallow

Rule

Path

Disallow

mediapartners-google

Rule	Path
Disallow

Rule

Path

Disallow

Warnings

`request-rate` is not a known field.

mcpe.kalvlad1994.rurobots.txt

Resource Scan

Scan Details

Last Successful Scan

Groups

googlebot

baiduspider

yandexbot

ichiro

sogou spider

sosospider

youdaobot

yetibot

bingbot

Other Records

yahoo! slurp

Other Records

rdfbot

seznambot

ia_archiver

mediapartners-google

Warnings

mcpe.kalvlad1994.ru
robots.txt