ladymakeup.pl
robots.txt

Robots Exclusion Standard data for ladymakeup.pl

Resource Scan

Scan Details

Site Domain ladymakeup.pl
Base Domain ladymakeup.pl
Scan Status Ok
Last Scan2024-09-17T19:05:36+00:00
Next Scan 2024-10-17T19:05:36+00:00

Last Scan

Scanned2024-09-17T19:05:36+00:00
URL https://ladymakeup.pl/robots.txt
Redirect https://www.ladymakeup.pl/robots.txt
Redirect Domain www.ladymakeup.pl
Redirect Base ladymakeup.pl
Domain IPs 52.211.7.40, 54.72.126.18
Redirect IPs 52.211.7.40, 54.72.126.18
Response IP 52.211.7.40
Found Yes
Hash 608b049d0bc2ab0f13b00660d5a948e062418f0ca18c09b303d689cd016f3d5c
SimHash 341643927e33

Groups

*

Rule Path
Allow /
Disallow /rc/
Disallow /n/
Disallow /qr/
Disallow /forum/
Disallow *%2C*
Disallow *?*pf=
Disallow *?*pt=
Disallow *?*s=
Disallow *?*st=
Disallow *?*pr=
Disallow *?*n=
Disallow *?*query=
Disallow *?*search=
Disallow *?*PageSpeed=

ninja

Rule Path
Disallow /

ninjabot

Rule Path
Disallow /

colocrossing

Rule Path
Disallow /

majestic

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

sogou

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

getintent

Rule Path
Disallow /

gigabot

Rule Path
Disallow /

ltx71

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

hybridbot

Rule Path
Disallow /

proximic

Rule Path
Disallow /

grapeshotcrawler

Rule Path
Disallow /

mail.ru_bot/2.0

Rule Path
Disallow /

plukkie

Rule Path
Disallow /

deusu

Rule Path
Disallow /

xovibot

Rule Path
Disallow /

bhcbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

femtosearchbot

Rule Path
Disallow /

yoozbot

Rule Path
Disallow /

awariorssbot

Rule Path
Disallow /

linkdexbot

Rule Path
Disallow /

demandbase

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

botscout

Rule Path
Disallow /

spbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.ladymakeup.pl/sitemap.xml