novini.bg
robots.txt

Robots Exclusion Standard data for novini.bg

Resource Scan

Scan Details

Site Domain novini.bg
Base Domain novini.bg
Scan Status Ok
Last Scan2024-11-09T00:47:39+00:00
Next Scan 2024-11-16T00:47:39+00:00

Last Scan

Scanned2024-11-09T00:47:39+00:00
URL https://novini.bg/robots.txt
Domain IPs 82.119.92.230
Response IP 82.119.92.230
Found Yes
Hash da1c8194e04929ac21eb61fe32feba0faf5609569965d4ea9320b9e071142ccf
SimHash 6b1001516fc3

Groups

*

Rule Path
Disallow /bashCK/
Disallow /search
Disallow /apps/*

adstxt/1.0

Rule Path
Allow /ads.txt

grapeshot

Rule Path
Disallow

Other Records

Field Value
sitemap https://novini.bg/statics/sitemap/sitemap_index.xml

Comments

  • Allow search crawlers to discover the sitemap