test-debit.net
robots.txt

Robots Exclusion Standard data for test-debit.net

Archived Snapshots

Resource Scan

Scan Details

Site Domain	test-debit.net
Base Domain	test-debit.net
Scan Status	Ok
Last Scan	2024-06-28T16:18:39+00:00
Next Scan	2024-07-05T16:18:39+00:00

Last Scan

Scanned	2024-06-28T16:18:39+00:00
URL	https://test-debit.net/robots.txt
Redirect	https://www.test-debit.net/robots.txt
Redirect Domain	www.test-debit.net
Redirect Base	test-debit.net
Domain IPs	104.21.20.19, 172.67.190.215, 2606:4700:3031::6815:1413, 2606:4700:3032::ac43:bed7
Redirect IPs	104.21.20.19, 172.67.190.215, 2606:4700:3031::6815:1413, 2606:4700:3032::ac43:bed7
Response IP	104.21.20.19
Found	Yes
Hash	5979259beff38994488da970068711c113b42276307a60ab9776b746dbdfdd8e
SimHash	624c0c51c7d8

Groups

*

Rule	Path
Disallow	/ver-producto/*
Disallow	/producto*

Rule

Path

Disallow

/ver-producto/*

Disallow

/producto*

bingbot

No rules defined. All paths allowed.

Other Records

Field	Value
crawl-delay	5

Field

Value

crawl-delay

yandex

Rule	Path
Disallow	/

Rule

Path

Disallow

yandexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou spider

Rule	Path
Disallow	/

Rule

Path

Disallow

sogou web spider

Rule	Path
Disallow	/

Rule

Path

Disallow

ahrefsbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mj12bot

Rule	Path
Disallow	/

Rule

Path

Disallow

domaincrawler

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot

Rule	Path
Disallow	/

Rule

Path

Disallow

semrushbot-sa

Rule	Path
Disallow	/

Rule

Path

Disallow

httrack

Rule	Path
Disallow	/

Rule

Path

Disallow

scrapy

Rule	Path
Disallow	/

Rule

Path

Disallow

zoombot

Rule	Path
Disallow	/

Rule

Path

Disallow

brandverity

Rule	Path
Disallow	/

Rule

Path

Disallow

spiderling

Rule	Path
Disallow	/

Rule

Path

Disallow

buck

Rule	Path
Disallow	/

Rule

Path

Disallow

tigerbot

Rule	Path
Disallow	/

Rule

Path

Disallow

ltx71

Rule	Path
Disallow	/

Rule

Path

Disallow

ltx71 - (http://ltx71.com/)

Rule	Path
Disallow	/

Rule

Path

Disallow

linkfluence

Rule	Path
Disallow	/

Rule

Path

Disallow

bot@linkfluence.net

Rule	Path
Disallow	/

Rule

Path

Disallow

evc-batch

Rule	Path
Disallow	/

Rule

Path

Disallow

zgrab

Rule	Path
Disallow	/

Rule

Path

Disallow

adscanner

Rule	Path
Disallow	/

Rule

Path

Disallow

mediatoolkitbot

Rule	Path
Disallow	/

Rule

Path

Disallow

blexbot

Rule	Path
Disallow	/

Rule

Path

Disallow

petalbot

Rule	Path
Disallow	/

Rule

Path

Disallow

mail.ru_bot

Rule	Path
Disallow	/

Rule

Path

Disallow

linguee

Rule	Path
Disallow	/

Rule

Path

Disallow

applebot

Rule	Path
Disallow	/

Rule

Path

Disallow

amazonbot

Rule	Path
Disallow	/

Rule

Path

Disallow

dataforseobot

Rule	Path
Disallow	/

Rule

Path

Disallow

dotbot

Rule	Path
Disallow	/

Rule

Path

Disallow

Other Records

Field	Value
sitemap	https://www.test-debit.net/sitemap.xml

Field

Value

sitemap

https://www.test-debit.net/sitemap.xml

test-debit.netrobots.txt

Resource Scan

Scan Details

Last Scan

Groups

*

bingbot

Other Records

yandex

yandexbot

sogou

sogou spider

sogou web spider

ahrefsbot

mj12bot

domaincrawler

dotbot

semrushbot

semrushbot-sa

httrack

scrapy

zoombot

brandverity

spiderling

buck

tigerbot

ltx71

ltx71 - (http://ltx71.com/)

linkfluence

bot@linkfluence.net

evc-batch

zgrab

adscanner

mediatoolkitbot

blexbot

petalbot

mail.ru_bot

linguee

applebot

amazonbot

dataforseobot

dotbot

Other Records

test-debit.net
robots.txt