pleta.bg
robots.txt

Robots Exclusion Standard data for pleta.bg

Resource Scan

Scan Details

Site Domain pleta.bg
Base Domain pleta.bg
Scan Status Ok
Last Scan2024-08-31T04:15:06+00:00
Next Scan 2024-09-30T04:15:06+00:00

Last Scan

Scanned2024-08-31T04:15:06+00:00
URL https://pleta.bg/robots.txt
Redirect https://www.pleta.bg/robots.txt
Redirect Domain www.pleta.bg
Redirect Base pleta.bg
Domain IPs 185.123.190.157
Redirect IPs 185.123.190.157
Response IP 185.123.190.157
Found Yes
Hash 0ed7675e977693e916fb04bd1d506d3063f9b96384b026b983f5ce13a4278e50
SimHash 08404836c591

Groups

*

Rule Path
Allow /
Disallow /*/catalogsearch/

ninjabot

Rule Path
Allow /

googlebot - image

Rule Path
Allow /

googlebot - mobile

Rule Path
Allow /

adsbot - google

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.pleta.bg/sitemap.xml

Comments

  • Crawl-delay: 30