/.well-known/

Log In Sign Up

new-xxx.video
robots.txt

Robots Exclusion Standard data for new-xxx.video

Archived Snapshots

Resource Scan

Scan Details

Site Domain	new-xxx.video
Base Domain	new-xxx.video
Scan Status	Ok
Last Scan	2025-03-16T22:45:23+00:00
Next Scan	2025-04-15T22:45:23+00:00

Last Scan

Scanned	2025-03-16T22:45:23+00:00
URL	https://new-xxx.video/robots.txt
Domain IPs	104.21.15.236, 172.67.208.159, 2606:4700:3031::6815:fec, 2606:4700:3034::ac43:d09f
Response IP	104.21.15.236
Found	Yes
Hash	3a32ac581777d6ef87e54b90b8878ea185afe04d7e100d2f503c74622159bc1a
SimHash	db1d414262a3

Groups

*

Rule

Path

Disallow

/search*

Disallow

/o/*

Disallow

/v/*

bingbot

Rule

Path

Disallow

/

yandex

Rule

Path

Disallow

/

ahrefsbot

Rule

Path

Disallow

/

semrushbot

Rule

Path

Disallow

/

semrushbot-sa

Rule

Path

Disallow

/

mj12bot

Rule

Path

Disallow

/

siteexplorer

Rule

Path

Disallow

/

xovibot

Rule

Path

Disallow

/

megaindex

Rule

Path

Disallow

/

spbot

Rule

Path

Disallow

/

yisouspider

Rule

Path

Disallow

/

seznambot

Rule

Path

Disallow

/

smtbot

Rule

Path

Disallow

/

mail.ru_bot

Rule

Path

Disallow

/

wbsearchbot

Rule

Path

Disallow

/

blexbot

Rule

Path

Disallow

/

coccocbot-web

Rule

Path

Disallow

/

yeti

Rule

Path

Disallow

/

ccbot

Rule

Path

Disallow

/

proximic

Rule

Path

Disallow

/

comscore

Rule

Path

Disallow

/

gptbot

Rule

Path

Disallow

/

claudebot

Rule

Path

Disallow

/

dotbot

Rule

Path

Disallow

/

applebot-extended

Rule

Path

Disallow

/

deepseekbot

Rule

Path

Disallow

/

Back to top