novaja.lv
robots.txt

Robots Exclusion Standard data for novaja.lv

Resource Scan

Scan Details

Site Domain novaja.lv
Base Domain novaja.lv
Scan Status Ok
Last Scan2024-11-08T05:09:56+00:00
Next Scan 2024-11-15T05:09:56+00:00

Last Scan

Scanned2024-11-08T05:09:56+00:00
URL https://novaja.lv/robots.txt
Redirect https://www.novaja.lv/robots.txt
Redirect Domain www.novaja.lv
Redirect Base novaja.lv
Domain IPs 104.21.85.12, 172.67.200.177
Redirect IPs 104.21.85.12, 172.67.200.177
Response IP 172.67.200.177
Found Yes
Hash b3fbd461e3134adf611a41506c8dffa937904957061934fc112ae17a26bd4cc5
SimHash 4324c423cd10

Groups

ahrefsbot
amazonbot
applebot
barkrowler
ccbot
facebookbot
gptbot
mj12bot
paqlebot
petalbot
semrushbot

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /api/
Disallow /autorizeties/
Disallow /cdn-cgi/
Disallow /*/komentari/

Other Records

Field Value
sitemap https://www.novaja.lv/wp-sitemap.xml