retail.ro
robots.txt

Robots Exclusion Standard data for retail.ro

Resource Scan

Scan Details

Site Domain retail.ro
Base Domain retail.ro
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-21T04:27:52+00:00
Next Scan 2025-12-05T04:27:52+00:00

Last Successful Scan

Scanned2025-10-13T10:22:15+00:00
URL https://retail.ro/robots.txt
Domain IPs 104.21.84.209, 172.67.197.36, 2606:4700:3032::ac43:c524, 2606:4700:3033::6815:54d1
Response IP 172.67.197.36
Found Yes
Hash fb1bf9918406adcb67c23a150789c435996fc4d8d5943f6d1bdc35e1bcea9f15
SimHash e019d872ca17

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /track/
Disallow /actions.html
Disallow /channel.html

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Other Records

Field Value
sitemap https://retail.ro/sitemaps/sitemap.xml
sitemap https://retail.ro/sitemaps/news.xml
sitemap https://www.retail.ro/sitemaps_old/sitemap_index.xml