cm.engineering
robots.txt

Robots Exclusion Standard data for cm.engineering

Resource Scan

Scan Details

Site Domain cm.engineering
Base Domain cm.engineering
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2025-10-20T11:54:41+00:00
Next Scan 2026-01-18T11:54:41+00:00

Last Successful Scan

Scanned2025-06-16T01:01:20+00:00
URL https://cm.engineering/robots.txt
Redirect https://cm.engineering/robots.txt?gi=846344ce8174
Domain IPs 52.0.16.118, 52.1.119.170, 52.1.147.205, 52.1.173.203, 52.4.145.119, 52.4.175.111, 52.4.225.124, 52.4.240.221, 52.4.38.70, 52.5.181.79, 52.6.3.192, 52.6.46.142
Response IP 52.6.46.142
Found Yes
Hash ec988f8c8cdbae43a4bfa100114488f1330a2440bcc530dd38f9522f8e3b76bc
SimHash 6910bb44c772

Groups

*

Rule Path
Disallow /m/
Disallow /me/
Disallow /%40me$
Disallow /%40me/
Disallow /*/edit$
Disallow /*/*/edit$
Disallow /media/
Disallow /p/*/share
Disallow /r/
Disallow /trending
Disallow /search?q$
Disallow /search?q=
Disallow /*/search?q=
Disallow /*/search/*?q=
Disallow /*/*source%3D
Allow /_/
Allow /_/api/users/*/meta
Allow /_/api/users/*/profile/stream
Allow /_/api/posts/*/responses
Allow /_/api/posts/*/responsesStream
Allow /_/api/posts/*/related

applebot-extended
bytespider
claudebot
facebookbot
googleother
google-extended
gptbot

Rule Path
Disallow /
Allow /about
Allow /business
Allow /earn
Allow /gift
Allow /membership
Allow /partner-program
Allow /verified-authors

Other Records

Field Value
sitemap https://cm.engineering/sitemap/sitemap.xml