ron-del.com
robots.txt

Robots Exclusion Standard data for ron-del.com

Resource Scan

Scan Details

Site Domain ron-del.com
Base Domain ron-del.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-03T14:00:36+00:00
Next Scan 2024-10-03T14:00:36+00:00

Last Successful Scan

Scanned2024-07-13T13:59:07+00:00
URL https://www.ron-del.com/robots.txt
Domain IPs 2600:9000:20fe:4000:8:2ec0:dcc0:93a1, 2600:9000:20fe:9e00:8:2ec0:dcc0:93a1, 2600:9000:20fe:ac00:8:2ec0:dcc0:93a1, 2600:9000:20fe:be00:8:2ec0:dcc0:93a1, 2600:9000:20fe:d200:8:2ec0:dcc0:93a1, 2600:9000:20fe:e800:8:2ec0:dcc0:93a1, 2600:9000:20fe:ee00:8:2ec0:dcc0:93a1, 2600:9000:20fe:f800:8:2ec0:dcc0:93a1, 3.163.125.51, 3.163.125.83, 3.163.125.85, 3.163.125.92
Response IP 18.165.171.3
Found Yes
Hash 1b2722e4a0e9d38f41c8a12ac38614961c85ac17ad39579cef2bdb70647ff133
SimHash 351445456553

Groups

dotbot disallow: / user-agent: semrushbot disallow: / user-agent: semrushbot-sa disallow: / user-agent: semrushbot-ba disallow: / user-agent: semrushbot-si disallow: / user-agent: semrushbot-swa disallow: / user-agent: semrushbot-ct disallow: / user-agent: semrushbot-bm disallow: / user-agent: semrushbot-seoab disallow: / user-agent: petalbot disallow: / user-agent: serpstatbot disallow: / user-agent: zoominfobot disallow: / user-agent: mj12bot disallow: / user-agent: barkrowler disallow: / user-agent: baiduspider user-agent: 360spider user-agent: yisouspider disallow: / user-agent: bytespider disallow: / user-agent: sogou web spider disallow: / user-agent: sogou inst spider disallow: / user-agent: adsbot disallow: / user-agent: ahrefsbot crawl-delay: 10 user-agent: * allow: / crawl-delay: 10 disallow: /dataproxy/ disallow: /?disable_pc_preview=true disallow: /scenario.aspx disallow: /render.ashx sitemap: /sitemap.xml

No rules defined. All paths allowed.