ciphrexlabs.com
robots.txt

Robots Exclusion Standard data for ciphrexlabs.com

Resource Scan

Scan Details

Site Domain ciphrexlabs.com
Base Domain ciphrexlabs.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2026-02-04T04:57:58+00:00
Next Scan 2026-03-06T04:57:58+00:00

Last Successful Scan

Scanned2026-01-06T03:08:21+00:00
URL https://ciphrexlabs.com/robots.txt
Domain IPs 194.164.64.52, 2a02:4780:2b:1608:0:3a71:a3c8:2
Response IP 194.164.64.52
Found Yes
Hash 5d6fb7e7bc051efeb11983869b1c9faa65d7fb813cfce1228af8d305f2940a2c
SimHash 0953fa53c591

Groups

googlebot

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

adsbot-google-mobile-apps

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

baiduspider

Rule Path
Allow /

yandexbot

Rule Path
Allow /

sogou

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

ezoicbot

Rule Path
Allow /

*

Rule Path
Disallow /admin/
Disallow /matomo/
Allow /

Other Records

Field Value
sitemap https://ciphrexlabs.com/sitemap.php
sitemap https://ciphrexlabs.com/sitemap.xml