textypesen.com
robots.txt

Robots Exclusion Standard data for textypesen.com

Resource Scan

Scan Details

Site Domain textypesen.com
Base Domain textypesen.com
Scan Status Ok
Last Scan2024-10-03T16:53:20+00:00
Next Scan 2024-10-10T16:53:20+00:00

Last Scan

Scanned2024-10-03T16:53:20+00:00
URL https://textypesen.com/robots.txt
Domain IPs 104.21.82.87, 172.67.155.112, 2606:4700:3033::6815:5257, 2606:4700:3036::ac43:9b70
Response IP 104.21.82.87
Found Yes
Hash a725815b4043552047bb191d0931db5beb06d38be1d0189a48fe70b520ef7543
SimHash dedf48e0fa91

Groups

*
yandex

Rule Path
Disallow /search/
Disallow /system/

yandex
semrushbot
dataforseobot
dotbot
barkrowler
petalbot
serendeputybot
mj12bot
netestate
blexbot
seopultcontentanalyzer
ccbot
megaindex
megaindexbot
serpstatbot
zoominfobot
linkfluence
netcraftsurveyagent
geedobot

Rule Path
Disallow /

Warnings

  • `clean-param` is not a known field.