test-velocidad.com
robots.txt

Robots Exclusion Standard data for test-velocidad.com

Archived Snapshots

Resource Scan

Scan Details

Site Domain	test-velocidad.com
Base Domain	test-velocidad.com
Scan Status	Ok
Last Scan	2024-10-05T05:59:10+00:00
Next Scan	2024-10-12T05:59:10+00:00

Last Scan

Scanned	2024-10-05T05:59:10+00:00
URL	https://test-velocidad.com/robots.txt
Redirect	https://www.test-velocidad.com/robots.txt
Redirect Domain	www.test-velocidad.com
Redirect Base	test-velocidad.com
Domain IPs	104.21.49.181, 172.67.165.134, 2606:4700:3032::6815:31b5, 2606:4700:3033::ac43:a586
Redirect IPs	104.21.49.181, 172.67.165.134, 2606:4700:3032::6815:31b5, 2606:4700:3033::ac43:a586
Response IP	172.67.165.134
Found	Yes
Hash	b8864439d0ed278031f2b7b3d9ace84d794e72cf710d0a53ec91b71cd0f9232f
SimHash	764c0840c7d2

Groups

*

Rule	Path
Disallow	/ver-producto/*
Disallow	/producto*

Rule

Path

Disallow

/ver-producto/*

Disallow

/producto*

bingbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	5

Field

Value

crawl-delay

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

zoombot

Rule	Path
Disallow	/

Rule

Path

Disallow

brandverity

Rule	Path
Disallow	/

Rule

Path

Disallow

spiderling

Rule	Path
Disallow	/

Rule

Path

Disallow

buck

Rule	Path
Disallow	/

Rule

Path

Disallow

tigerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ltx71

Rule	Path
Disallow	/

Rule

Path

Disallow

ltx71 - (http://ltx71.com/)

Rule	Path
Disallow	/

Rule

Path

Disallow

linkfluence

Rule	Path
Disallow	/

Rule

Path

Disallow

bot@linkfluence.net

Rule	Path
Disallow	/

Rule

Path

Disallow

evc-batch

Rule	Path
Disallow	/

Rule

Path

Disallow

zgrab

Rule	Path
Disallow	/

Rule

Path

Disallow

adscanner

Rule	Path
Disallow	/

Rule

Path

Disallow

mediatoolkitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

linguee

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.test-velocidad.com/sitemap.xml

Field

Value

sitemap

https://www.test-velocidad.com/sitemap.xml

test-velocidad.comrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

bingbot

Other Records

yandex

yandexbot

sogou

sogou spider

sogou web spider

ahrefsbot

mj12bot

domaincrawler

dotbot

semrushbot

semrushbot-sa

httrack

scrapy

zoombot

brandverity

spiderling

buck

tigerbot

ltx71

ltx71 - (http://ltx71.com/)

linkfluence

bot@linkfluence.net

evc-batch

zgrab

adscanner

mediatoolkitbot

blexbot

petalbot

mail.ru_bot

linguee

applebot

amazonbot

dataforseobot

dotbot

Other Records

test-velocidad.com
robots.txt