AB
AiBoss
project

CloudDM - an open-source database development and management platform from the ClouGence team.

CloudDM is an open-source database development and management platform from the ClouGence team. CloudDM integrates core database capabilities such as data querying, SQL auditing, and access control into a unified platform, supporting 30 data sources, covering MySQL...

What is CloudDM?

CloudDM is an open-source database development and management platform developed by the ClouGence team. CloudDM integrates core database capabilities such as data querying, SQL auditing, and access control into a unified platform. It supports 30 data sources, covering MySQL, PostgreSQL, ClickHouse, Redis, StarRocks, and cloud databases such as Alibaba Cloud, AWS, and Azure, providing DBAs, developers, and operations personnel with a one-stop database collaboration and governance solution.

Main functions of CloudDM

  • Unified Data QueryThe web console supports 30 data sources and provides capabilities such as syntax highlighting, intelligent suggestions, execution plans, result export, table structure retrieval, and transaction and isolation level control.
  • SQL Change ControlIt features a built-in SQL approval rule engine with 54 lines, supports custom Rule Script extensions, and allows rules to be applied precisely to instances, databases, tables, and columns. The approval process integrates with Lark, DingTalk, and WeChat Work.
  • Fine-grained permission managementIt adopts the RBAC model that separates functional permissions from resource permissions, and the authorization granularity covers instances, databases, schemas, and tables, supporting separate authorization for DDL and DML.
  • Data anonymization protectionIt provides column-level desensitization capabilities, with 5 built-in desensitization rules and support for customization. It can desensitize a single value or an entire row, with the protection scope accurate to the column level.
  • Unified Identity AuthenticationSupports OpenLDAP, Windows AD, OIDC, as well as DingTalk, Lark, and WeChat Work SSO, facilitating a unified account system for the team.
  • Database object managementThe visual editor supports the creation, deletion, modification, and property viewing of objects such as libraries, schemas, tables, columns, indexes, views, functions, stored procedures, and triggers.
  • Audit and ComplianceIt provides operation auditing and SQL execution auditing, and supports three execution methods: manual execution, immediate execution, and scheduled execution.
  • CI/CD IntegrationIt supports three methods to trigger the change release process: Git Push, WebHook, and HttpCall. The inspection, approval, and execution nodes can be started and stopped at will.
  • DDL ConversionSupports 18 data sources to 12 target databases including MySQL, ClickHouse, DM, Oracle, and PostgreSQL, with a total of 192 conversions.

CloudDM's technical principles

  • Web console architectureIt adopts a front-end and back-end separation design, allowing unified access and management of multiple data sources through a browser without the need to install a local client.
  • SQL rule engineThe built-in rule engine performs static analysis and security checks on change statements, and implements extensible rule definitions based on Rule Script, supporting four range matching modes: exact, prefix, suffix, and inclusion.
  • RBAC two-layer permission modelDecouple functional permissions (menus and operations) from resource permissions (data source objects), and implement fine-grained access control at the instance, database, schema, table and column levels through role definition.
  • Multi-protocol data source adaptationIt connects to the underlying database via the standard JDBC/ODBC protocol, and provides a unified abstraction of query and management interfaces for 30 heterogeneous data sources.
  • Elastic Deployment ArchitectureIt supports both standalone and cluster modes, and provides two containerized deployment methods: Docker and Kubernetes. Cross-data center management does not require exposing public network ports.
  • Desensitization and auditing mechanisms: Incorporate a column-level desensitization layer in the data return chain, and persistently audit and store operation behavior and SQL execution records.

How to use CloudDM

  • One-click deploymentExecute Docker commands docker run -d --name cgdm-alone -p 8222:8222 bladepipe/cgdm-alone:3.0.7Startup is completed within 10 seconds (within China, the Alibaba Cloud mirror acceleration address can be used).
  • Access the consoleOpen in browser http://localhost:8222Complete the initial configuration.
  • Accessing data sourcesAdd 30 supported database connections, including MySQL and PostgreSQL, to the data source management.
  • Configure permissionsCreate roles and assign functional and resource permissions, with precise control down to the database, table, or column level.
  • Set review rulesEnable or customize SQL auditing rules in security rules, and configure prompting or blocking policies.
  • Perform a query or change: Write SQL through the query console or submit changes through the work order system, and execute them after approval.
  • Enterprise IMConfigure DingTalk, Lark, or Enterprise Webhook to enable work order notifications and SSO login.

CloudDM's core advantages

  • Fully open source with zero restrictionsAll features are fully open, with no enterprise version limitations, and advanced capabilities such as access control and auditing are available for free.
  • The widest range of data sources covering the most industriesIt supports 30 data sources, covering mainstream domestic and international relational databases, OLAP, caching, and cloud databases.
  • Extremely fine-grained access controlIt supports multi-level authorization at the instance, database, schema, table, and column levels, and allows for separate control of DDL and DML to meet enterprise compliance requirements.
  • The rules engine is highly flexible54 built-in rules, combined with Rule Script for customization, with scope accurate to the column level, adapting to the SQL specifications of different teams.
  • Low barrier to entry for deployment and maintenanceDocker can be started with one click, supporting single-machine and cluster deployments. Cross-data center deployments do not require public network ports, reducing the cost of private deployment.

CloudDM project address

  • Project official websitehttps://www.cdmgr.com/
  • GitHub repositoryhttps://github.com/ClouGence/open-cdm

CloudDM's Competitive Product Comparison

Dimension CloudDM Archery Yearning Bytebase
Open source license Apache 2.0 (Full Feature) Apache 2.0 GPL Some open source/commercial versions
Data source support 30 types (including cloud databases) less less More
Data Query Web console
SQL auditing rules 54 built-in + custom entries have have have
Permission granularity Instance/Library/Schema/Table/Column coarser coarser Library/table level
Data anonymization Column Partial support
SSO Integration LDAP/AD/OIDC/DingTalk/LargeBook/WeChat Work limited limited OIDC/LDAP
CI/CD Integration Git Push/WebHook/HttpCall limited limited GitOps
Deployment method Docker/K8s/installation package More complicated generally Docker/K8s

CloudDM application scenarios

  • Unified management and control of enterprise databasesProvides DBAs and development teams with a unified data query portal and change process, avoiding the need to switch between multiple tools.
  • SQL Auditing and Compliance GovernanceIt intercepts dangerous SQL queries through an automated rules engine, meeting the compliance and auditing requirements of industries such as finance and the internet.
  • Sensitive data security protectionAutomatically desensitize sensitive columns in core tables of the production environment to prevent data leakage.
  • DevOps Database Change PipelineIntegrate database changes into the CI/CD process to achieve automated deployment and rollback driven by Git.
  • Multi-tenant access control: Assign independent data access boundaries to different teams and projects through fine-grained RBAC.