Confidential Computing Zoo (CCZoo) is a collection of code-ready reference solutions, which can be used as a copy-paste developer guide, demonstrating how to apply modern security technologies to real-life cloud business scenarios, in order to facilitate the developers to build their own end-to-end Confidential Computing solutions more easily. Some of the solutions are also validated on the public cloud services, such as Alibaba Cloud, Tencent Cloud, AWS, Azure, etc. Please see Cloud Deployment.

The concerned modern security technologies are (but not limited to): TEE (Trusted Execution Environment, such as Intel® SGX and TDX), HE (Homomorphic Encryption) and its
hardware accelerations, Remote Attestation, LibOS, cryptographic and its hardware accelerations. The concerned business scenarios are (but not limited to): cloud native AI
inference, vertical and horizontal federated learning, big data analytics, key management, RPC (Remote Process Call, such as gRPC), etc.

CCZoo maintains a live table, as below, to indicate the correlations between business usages (rows) and security technologies (columns). Each hyperlink will direct you to the
document section that explains the corresponding details and then guides you to the source codes. Enjoy!

Solution List (Solution to Component Correlation)

<table border="1" bordercolor="#000000" cellpadding="2" cellspacing="0" style="width:100%;"> <tbody> <tr> <td rowspan="3">   Solution </td> <td colspan="11" rowspan="1">                                                     Security Components </td> <td colspan="1" rowspan="3"> Validated in Public Cloud </td> <td colspan="1" rowspan="3"> Status </td> </tr> <tr> <td colspan="2" rowspan="1">   TEE </td> <td colspan="2" rowspan="1">            LibOS </td> <td colspan="2" rowspan="1"> Remote Attestation </td> <td colspan="2" rowspan="1">     KMS </td> <td colspan="1" rowspan="2"> HE </td> <td colspan="1" rowspan="2" style="text-align:center;"> Crypto </td> <td colspan="1" rowspan="2"> TLS </td> </tr> <tr> <td colspan="1"> SGX </td> <td colspan="1"> TDX </td> <td style="text-align:center;"> Gramine </td> <td style="text-align:center;"> Occlum </td> <td> *<a href="https://cczoo.readthedocs.io/en/main/Solutions/rats-tls/index.html">RATS-TLS</a> </td> <td> *<a href="https://cczoo.readthedocs.io/en/main/Solutions/grpc-ra-tls/index.html">RA-TLS gRPC</a> </td> <td style="text-align:center;"> Vault </td> <td style="text-align:center;"> <a href="https://cczoo.readthedocs.io/en/main/Solutions/ehsm-kms/index.html">eHSM-KMS</a> </td> </tr> <tr> <td colspan="14"> Multi-Party Compute / Federated Learning </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/horizontal-federated-learning/hfl.html" target="_blank">Horizontal Federated Learning </a> (TensorFlow) </td> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/horizontal-federated-learning/hfl.html" target="_blank">Yes</a> </td> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tdx-hfl/tdx-hfl.html" target="_blank">Yes</a> </td> <td> Yes </td> <td> - </td> <td> - </td> <td> Yes (2-way) </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> Yes (RA-gRPC) </td> <td> <a href="https://cczoo.readthedocs.io/en/main/Solutions/horizontal-federated-learning/hfl.html#aliyun-ecs">Alibaba Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/horizontal-federated-learning/hfl.html#tencent-cloud">Tencent Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/horizontal-federated-learning/hfl.html" target="_blank">ByteDance Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/horizontal-federated-learning/hfl.html#microsoft-azure">Microsoft Azure</a> </td> <td> Published </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank">Vertical Federated Learning</a><a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank"> </a> (TensorFlow) </td> <td> Yes </td> <td> - </td> <td> Yes </td> <td> - </td> <td> - </td> <td> Yes (2-way) </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> Yes (RA-gRPC) </td> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank">Alibaba Cloud</a>, <a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank">Tencent Cloud</a>, <a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank">ByteDance Cloud</a>, <a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank">Microsoft Azure</a> </td> <td> Published </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/psi/PSI.html">Private Set Intersection </a> </td> <td> Yes </td> <td> - </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes (RA-gRPC) </td> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/psi/PSI.html" target="_blank">ByteDance Cloud</a>, <a href="https://cczoo.readthedocs.io/en/latest/Solutions/psi/PSI.html" target="_blank">Microsoft Azure</a> </td> <td> Published </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/phe_homo_lr/phe_homo_lr.html">Secure Logistic Regression Training Based on TEE & HE </a> </td> <td> Yes </td> <td> - </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> Yes </td> <td> Yes </td> <td> Alibaba Cloud, Tencent Cloud </td> <td> Published </td> </tr> <tr> <td colspan="14"> Secure AI Inference & Training </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tensorflow-serving-cluster/index.html" target="_blank">TensorFlow Serving Cluster PPML</a> (TensorFlow, K8S) </td> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tensorflow-serving-cluster/index.html" target="_blank">Yes</a> </td> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tdx-tf-serving-ppml/index.html" target="_blank">Yes</a> </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> Yes </td> <td> <a href="https://cczoo.readthedocs.io/en/main/Solutions/tensorflow-serving-cluster/index.html#alibaba-cloud">Alibaba Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/tensorflow-serving-cluster/index.html#tencent-cloud">Tencent Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/tensorflow-serving-cluster/index.html#bytedance-cloud" target="_blank">ByteDance Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/tensorflow-serving-cluster/index.html#microsoft-azure" target="_blank">Microsoft Azure</a> </td> <td> Published </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html" target="_blank">Secure Logistic Logical Regression Inference with HE and SGX</a> </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> - </td> <td> - </td> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html">Alibaba Cloud</a>, <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html">Tencent Cloud</a>, <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html" target="_blank">ByteDance Cloud</a>, <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html" target="_blank">Microsoft Azure</a> </td> <td> Published </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/bigdl-ppml/index.html" target="_blank">BigDL PPML </a> </td> <td> Yes </td> <td> Yes </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> <a href="https://www.intel.com/content/dam/www/central-libraries/us/en/documents/alibaba-ppml-ai-blog-pdf.pdf">Ant Group</a>, <a href="https://networkbuilders.intel.com/solutionslibrary/reference-architecture-for-confidential-computing-on-skt-5g-mec">SKT</a> </td> <td> In Progress </td> </tr> <tr> <td colspan="14"> Native Application Hosting </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/cross_language_framework_based_gramine/Readme.html" target="_blank">Cross Language framework Based on Gramine</a> </td> <td> Yes </td> <td> - </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Tencent Cloud </td> <td> Published </td> </tr> <tr> <td colspan="14"> Attestation Server & Key Management Service </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/attestation-secret-provision/index.html" target="_blank">Attestation and Secret Provision Service</a> </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> - </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> Yes </td> <td> - </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> Published </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/main/Solutions/ehsm-kms/index.html">eHSM-KMS</a> </td> <td> Yes </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> - </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> Published </td> </tr> <tr> <td colspan="14"> Optimization on Secure Libs </td> </tr> <tr> <td> Private Set intersection Optimization on Xeon </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> - </td> <td> Not Start </td> </tr> <tr> <td colspan="14"> Secure Database </td> </tr> <tr> <td> Secure Database Querying Based on HE </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> - </td> <td> Yes </td> <td> Yes </td> <td> - </td> <td> - </td> <td> Not Start </td> </tr> <tr> <td colspan="14"> Confidential AIGC </td> </tr> <tr> <td> Confidential LLM Inference (RAG)  </td> <td> </td> <td> WIP (1) TDVM  (2) CoCo (3) TDVM+GPU </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> </tr> <tr> <td> Confidential LLM Rec System   </td> <td> </td> <td> WIP (1) TDVM  (2) CoCo (3) TDVM+GPU </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> <td> </td> </tr> </tbody> </table>

Incubating Component Projects

Besides reference solutions, CCZoo is also incubating new projects of key security
components that are commonly used by multiple CCZoo reference solutions. Once any
of them is proven useful enough and stable enough via a thorough validation with
CCZoo reference solutions running on various public cloud services, it will graduate
from CCZoo and evolve to a standalone project.

<table border="1"> <tbody> <tr> <td colspan="1" rowspan="1"> Incubating Component Project'*' </td> <td colspan="1" rowspan="1">                                                                         Description </td> <td rowspan="1"> Status </td> <td colspan="1" rowspan="1"> Validated in Public Cloud </td> </tr> <tr> <td colspan="1"> <a href="https://cczoo.readthedocs.io/en/main/Solutions/rats-tls/index.html">RATS-TLS</a> </td> <td> This project provides a proof-of-concept implementation on how to integrate Intel SGX and TDX remote attestation into the TLS connection setup. Conceptually, it extends the standard X.509 certificate with SGX and TDX related information. It also provides two non-SGX clients (Wolfssl and OpenSSL) to show how seamless remote attestation works with different TLS libraries.  </td> <td> Published </td> <td> <a href="https://cczoo.readthedocs.io/en/main/Solutions/grpc-ra-tls/index.html#aliyun-ecs">Alibaba Cloud</a> </td> </tr> <tr> <td colspan="1"> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/grpc-ra-tls/index.html">RA-TLS Enhanced gRPC</a> </td> <td> This project provides an enhanced <a href="https://grpc.io/">gRPC</a> (Remote Procedure Call) framework to guarantee security during transmission and runtime via two-way <a href="https://arxiv.org/pdf/1801.05863">RA-TLS</a> (Intel SGX Remote Attestation with Transport Layer Security) based on <a href="https://en.wikipedia.org/wiki/Trusted_execution_environment">TEE</a> (Trusted Execution Environment). </td> <td> Published </td> <td> <a href="https://cczoo.readthedocs.io/en/main/Solutions/grpc-ra-tls/index.html#aliyun-ecs">Alibaba Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/grpc-ra-tls/index.html#tencent-cloud">Tencent Cloud</a>, <a href="https://cczoo.readthedocs.io/en/main/Solutions/grpc-ra-tls/index.html#bytedance-cloud" target="_blank">ByteDance Cloud</a> </td> </tr> <tr> <td> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/httpa/index.html" target="_blank">HTTPA</a> </td> <td>  HTTPA aims for two purposes. First, help perform remote attestation on the web application running inside the TEE in which the flow can be unilateral (one-way HTTPA) or bilateral (mutual HTTPA) by verifying attestation evidence with a verifier such as a trusted authority (TA). Second, help build secure communication directly with the web application at L7 running inside the TEE.  </td> <td> Published </td> <td> / </td> </tr> </tbody> </table>

Cloud Deployment

Solutions and incubating component projects in CCZoo are constantly extended to be validated in public clouds to verify the versatility, stability, robustness. We will provide detialed configurations of each public clouds for reference, and notes of the diversity in each cloud for easy delopyment.

Below table shows solutions and component projects validated in public clouds. And it will be updated continuously.

<table border="1" cellpadding="1" cellspacing="1" style="width:500px;"> <tbody> <tr> <td colspan="2">      Public Cloud </td> <td> Alibaba Cloud </td> <td> ByteDance Cloud </td> <td> Azure Cloud </td> <td> Tencent Cloud </td> </tr> <tr> <td rowspan="6" style="text-align:left;"> Instance  </td> <td style="text-align:left;"> Type </td> <td> <a href="https://help.aliyun.com/document_detail/108490.htm#section-bew-6jv-c0k">g7t</a> </td> <td> <div> ecs.ebmg2t.32xlarge </div> </td> <td> Standard_DC16s_v3 </td> <td> <a href="https://cloud.tencent.com/document/product/213/11518#M6ce">M6ce.4XLARGE128 </a> </td> </tr> <tr> <td style="text-align:left;"> Kernel </td> <td> 4.19.91-24 </td> <td> <div> kernel-5.15 </div> </td> <td> 5.13.0-1031-azure </td> <td> 5.4.119-19-0009.1 </td> </tr> <tr> <td style="text-align:left;"> OS </td> <td> Alibaba Cloud Linux 2.1903 </td> <td> Ubuntu20.04 </td> <td> Ubuntu Server 20.04 LTS - Gen2 </td> <td> TencentOS Server 3.1 </td> </tr> <tr> <td style="text-align:left;"> Memory </td> <td> 64G(32G EPC memory) </td> <td> <div> 512GB(256GB EPC memory) </div> </td> <td> 128G (64G EPC Memory) </td> <td> 64G(32G EPC memory) </td> </tr> <tr> <td style="text-align:left;"> vCPU </td> <td> 16 </td> <td> 16 </td> <td> 16 </td> <td> 16 </td> </tr> <tr> <td style="text-align:left;"> PCCS Server </td> <td> <a href="https://help.aliyun.com/document_detail/208095.html">sgx-dcap-server-vpc.cn-hangzhou.aliyuncs.com</a> </td> <td> <div> <a class="link rich-text-anchor __anchor-intercept-flag__" href="https://sgx-dcap-server.bytedance.com" target="_blank">sgx-dcap-server.bytedance.com</a> </div> </td> <td> N/A </td> <td> <a href="https://cloud.tencent.com/document/product/213/63353">sgx-dcap-server-tc.sh.tencent.cn </a> </td> </tr> <tr> <td colspan="2"> Validated Solution  </td> <td style="vertical-align:top;"> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tensorflow-serving-cluster/index.html">TensorFlow Serving Cluster PPML</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/horizontal-federated-learning/hfl.html">Horizontal Federated Learning</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html" target="_blank">Secure Logistic Logical Regression Inference with HE and SGX</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/grpc-ra-tls/index.html">RA-TLS Enhanced gRPC</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/phe_homo_lr/phe_homo_lr.html">Secure logistic regression training base on TEE & HE</a> </li> </ul> </td> <td style="vertical-align:top;"> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tensorflow-serving-cluster/index.html">TensorFlow Serving Cluster PPML</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/horizontal-federated-learning/hfl.html">Horizontal Federated Learning</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/grpc-ra-tls/index.html">RA-TLS Enhanced gRPC</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank">Vertical Federated Learning</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html" target="_blank">Secure Logistic Logical Regression Inference with HE and SGX</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/psi/PSI.html" target="_blank">Private Set Intersection (PSI)</a> </li> </ul> </td> <td style="vertical-align:top;"> <ul> <li>  <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tensorflow-serving-cluster/index.html">TensorFlow Serving Cluster PPML</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/horizontal-federated-learning/hfl.html">Horizontal Federated Learning</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/vertical-federated-learning/vfl.html" target="_blank">Vertical Federated Learning</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html" target="_blank">Secure Logistic Logical Regression Inference with HE and SGX</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/psi/PSI.html" target="_blank">Private Set Intersection (PSI)</a> </li> </ul> </td> <td style="vertical-align:top;"> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/tensorflow-serving-cluster/index.html">TensorFlow Serving Cluster PPML</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/horizontal-federated-learning/hfl.html">Horizontal Federated Learning</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/grpc-ra-tls/index.html">RA-TLS Enhanced gRPC</a> </li> </ul> <ul> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/phe_homo_lr/phe_homo_lr.html">Secure logistic regression training base on TEE & HE</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/psi/PSI.html" target="_blank">Private Set Intersection (PSI)</a> </li> <li> <a href="https://cczoo.readthedocs.io/en/latest/Solutions/logistic-regression-inference-HE-SGX/index.html" target="_blank">Secure Logistic Logical Regression Inference with HE and SGX</a> </li> </ul> </td> </tr> </tbody> </table>

Penetration Testing

CCZoo provides a serials of Penetration Testing cases to demonstrate the cases to find/exploit
vulnerabilities of applications/frameworks/services under different scenarios without Intel TEE,
compared with Intel TEE runtime protection capability. Pen-tests cases can be found at https://cczoo.readthedocs.io.