What's Changed

• [Refactor/2.3] Refactor e2e_test utilities and independents by @zipper-meng in #1882
• Fix(2.3) bugs around compaction by @zipper-meng in #1889
• [LTS/2.3] ci: add compatibility test by @Kree0 in #1886

Full Changelog: v2.3.4.1...v2.3.4.2

What's Changed

• Fix/2.3: function dedup_by_front dropped wrong element by @zipper-meng in #1815
• Fix/2.3: async LruCache sometimes causes segment fault by @zipper-meng in #1820
• ci: fix docker ci by @Kree0 in #1824
• fix: create meta snapshot is empty by @bartliu827 in #1835
• refactor: remove cold_data_server and NodeAttribute by @lutengda in #1859
• add setkv/delete http interface in meta by @bartliu827 in #1856
• [LTS/2.3] fix: hide password when starting cli by @Kree0 in #1881

Full Changelog: v2.3.4...v2.3.4.1

What's Changed

• feat : adapt vector  #1628
• feat: addincrease function, http_limiter and metrics  #1629
• feat: routing both write requests and SQL requests to query server #1760
• feat: support HTTP compression #1762
• feat: support dump ddl #1782
• feat: start the service through configuration #1789
• refactor: implement desc tables/databases by reading system tables and fix some word error #1692
• improve: remove debug log  #1793
• fix: drop tenant not drop members bug #1632
• fix: failed to generate a plan for interpolation functions with an alias #1777
• fix: add check of parameter event_time_column of stream table #1744
• fix: stream job lost database info when restarthttps://github.com//pull/1734
• fix: disable creation of stream table with columns with the same name #1733
• fix: optimize the error message for direct select the stream table #1732
• fix: get_sys_mem unit error #1739
• fix: cli write line protocol didn't show error message #1739
• fix: fix when drop user don't drop tenant member #1739
• fix: fix Tenant not found return http status code 500 #1739
• fix: fix grpc size limit #1739
• fix: table name error when creating external table #1739

Full Changelog: v2.3.3...v2.3.4

What's Changed

• feat: support scalar function delta by @yukkit in #1395
• feat: support scalar function time_delta by @yukkit in #1405
• feature : adapt vector by @Subsegment in #1380
• docs: Update README.md by @IvanGao01 in #1415
• feat: support aggregate function first & last by @yukkit in #1413
• feat: impl duration_in for compact_state_agg by @ZuoTiJia in #1408
• ci: migrating part of ci by @lutengda in #1424
• fix: allow modify usage_schema database by @ZuoTiJia in #1421
• ci: change docker build to 18:00 every day from Monday to Friday by @lutengda in #1425
• feat: support state_agg and duration_in for state_agg by @ZuoTiJia in #1423
• fix: meta of user&tenant is inconsistent on multiple meta nodes by @yukkit in #1417
• refactor: implement desc tables/databases by reading system tables and fix some word error by @guojidan in #1397
• feat: impl state_at for state_agg by @ZuoTiJia in #1431
• fix: line protocol parser '\n' error by @Subsegment in #1426
• [fix]when drop tenant, do not drop data(#1311) by @lutengda in #1418
• Fix Some certificates were generated without --days option and now expired by @zipper-meng in #1441
• ci: add https_api_tests by @Kree0 in #1443
• feat: support scalar function rate by @yukkit in #1428
• feat: support aggregate function mode by @yukkit in #1440
• ci: add sql test cases by @Kree0 in #1448
• improve : optimize flatbuffer by @Subsegment in #1435
• refactor(tskv): record_file & codec by @zipper-meng in #1439
• refactor : map array to string by @Subsegment in #1450
• fix: modify the cases to be repeatable by @Kree0 in #1451
• improve: enable shell scripts to be added to test cases by @Kree0 in #1455
• feat: split wal by vnode by @Subsegment in #1454
• feat: support Geometry data type by @yukkit in #1463
• standardize_field_name by @guojidan in #1461
• push_down_ne by @guojidan in #1469
• improve: optimize build index by @Subsegment in #1468
• improve: change big dependency 'models' to small dependency 'error_code' by @ZuoTiJia in #1470
• support gis function by @yukkit in #1465
• Refactor iterator and optimize performance by @ZuoTiJia in #1467
• improve: Add histogram Line Protocol export by @ZuoTiJia in #1472
• fix : data lose when create tsf by @Subsegment in #1478
• feat: impl aggregate function increase by @ZuoTiJia in #1476
• refactor: refactor usage_schema by @ZuoTiJia in #1479
• doc: add comments to TSIndex struct by @yukkit in #1485
• fix: cancel query tasks on tskv by @yukkit in #1488
• doc: add limiter description by @ZuoTiJia in #1492
• refactor: rename coordinator limiter by @ZuoTiJia in #1482
• ci: enable e2e test by @Kree0 in #1496
• refactor: Add limiter manager by @ZuoTiJia in #1494
• fix : retry after update table conflict by @Subsegment in #1503
• refactor: clean up dead code VnodeStatusListener by @yukkit in #1487
• Add watch by @ZuoTiJia in #1497
• fix: fix alter database by @ZuoTiJia in #1504
• fix: cargo clippy by @ZuoTiJia in #1507
• ci: add github action packaging script by @Kree0 in #1514
• fix: fix http metrics field order error by @ZuoTiJia in #1506
• fix tsm damaged, but query not try read [1192] by @bartliu827 in #1453
• fix: stream plan not perform filter pushdown by @yukkit in #1515
• feat: support rename tag by @yukkit in #1484
• fix: arrow flight sql jdbc api: getCatalogs getSchemas getTables by @yukkit in #1520
• feat: support rename field by @yukkit in #1517
• fix: arrow flight sql getTables api by @yukkit in #1527
• fix: fix cli array out-of-bounds access by @ZuoTiJia in #1531
• fix: parser line protocol error by @Subsegment in #1537
• fix: Fix the problem of not reporting NodeMetrics in time by @ZuoTiJia in #1536
• fix: update table cause lose data by @Subsegment in #1538
• ci: add build k8s image and push to aliyun image repository by @Kree0 in #1540
• fix : restart lose data by @Subsegment in #1471
• ci: update docker image naming rule by @Kree0 in #1543
• ci: update docker image naming rule by @Kree0 in #1544
• ci: rename docker build yaml by @lutengda in #1545
• ci: update docker image naming rule by @Kree0 in #1548
• ci: update docker image naming rule by @Kree0 in #1551
• ci: optimize e2e_test structure, add new test cases by @Kree0 in #1524
• leader replication, multi raft replication group by @bartliu827 in #1534
• ci: update docker image building script by @Kree0 in #1554
• When drop table, the will deleted by @guojidan in #1553
• fix:drop database in raft replication mode by @bartliu827 in #1556
• ci: fix benchmark too many open files by @ZuoTiJia in #1559
• [Fix] Unexpectedly deleted the wal test directory by @zipper-meng in #1558
• ci: update default config file by @Kree0 in #1568
• ci: update cnosdb-build dockerfile, update dependencies installation script, remove Dockerfile_jenkins, Dockerfile_jenkins by @Kree0 in #1572
• feat: impl st_area function by @ZuoTiJia in #1574
• ci: update cnosdb docker image building script by @Kree0 in #1576
• support update field value & support update tags value by @yukkit in #1516
• ci: update packaging script by @Kree0 in #1585
• fix: fix password verify failed by @ZuoTiJia in #1583
• fix: fix time_window function cannot handle constant cast expression by @ZuoTiJia in #1578
• improve: decrease clone by @ZuoTiJia in #1582
• ci: update docker image building script by @Kree0 in #1592
• enhancement meta watch model[#1530] by @bartliu827 in #1586
• fix: fix rate bucket refill by @ZuoTiJia in #1563
• fix: Confusing error message by @Subsegment in #1595
• fix : restart recover invalid data by @Subsegment in #1570
• fix: forbidden drop root user by @yukkit in #1598
• fix: drop column case tskv get empty db by @Subsegment in #1581
• fix: /cluster/users/user change not notify to server [#1401] by @bartliu827 in #1599
• fix: meta create duplicate data version[#1495] by @bartliu827 in #1605
• feat: mark delete and mark modify by @lutengda in #1510
• halloween by @xuegexi in #1614
• update: cargo update by @ZuoTiJia in #1597
• fix: fix check scalar args check by @ZuoTiJia in #1615
• improve: Disable restrictions on Tenant cnosdb by @ZuoTiJia in #1617
• improve: seek pos before index read by @Subsegment in #1618
• fix: fix create system database usage_schema by @ZuoTiJia in #1606
• fix: update se...

Release date：Sep 28,2023

Improvements:

• Optimized read performance #1467
• Improved the Ord implementation of DataType #1467
• Added data block reader #1467
• Removed field scan timer #1467

Bug Fixes:

• Fixed the issue allowing modification of the usage_schema database #1421
• Resolved inconsistency issues with users and tenants on multiple metadata nodes #1417
• Fixed the problem of not deleting data when deleting a tenant #1418
• Resolved the issue of generating TLS lv-2 certificates without options #1441
• Fixed the data loss issue when creating TSF #1478
• Resolved the cancellation of queries on Tskv #1488
• Fixed retry after table update conflict #1503
• Fixed database modification issue #1504
• Fixed issues with Arrow Flight SQL JDBC API's getCatalogs, getSchemas, and getTables #1520
• Fixed the getTables API of Arrow Flight SQL #1528
• Resolved the delayed reporting of NodeMetrics #1541
• Fixed data loss issue due to table updates #1542
• Fixed errors in parsing Line Protocol #1539

Release date：Aug 02,2023

New Features:

• Add monitoring metric 'http_data_out' #1304
• Added chunked mode in the client #1357
• Added new log types to the WAL: DROP VNODE and DROP TABLE #1340

Improvements:

• Improved flight-sql implementation, added implementation for the do_put_prepared_statement_update interface #1329
• Enhanced meta watch and optimized interaction between queries #1314
• Upgraded datafusion version to 27.0.0 #1323
• Added additional methods to the flatbuffers model #1361

Bug Fixes:

• Fixed the issue of generating duplicate series IDs #1301
• Fixed the problem with the sample function returning errors #1296
• Fixed panic when writing to binlog #1309
• Fixed schema error in logical plan #1332
• Fixed parsing error in CREATE TABLE #1318
• Fixed json deserialization issue in raft_bucket #1347
• Fixed handshake failure for arrow-flight-sql odbc #1336
• Fixed out-of-memory issue when importing Line Protocol data #1319
• Fixed errors in data node health check #1352
• Fixed unintended deletion of irrelevant columns when deleting a table #1363
• Fixed client connection issue using ca.crt #1369
• Fixed tokio trace filtering #1372
• Fixed errors in inserting line protocol data #1366

Behavior Change:

• Configuration changes #1372
• Default TTL set to infinite when creating a database #1354

Release date：June 21,2023

New Features

• Added trace #1272
• Support sliding window gap fill #1171
• Support metadata API for Flight SQL #1173
• Support granting admin privileges #1929
• Implemented sample function #1228
• Client-side supports HTTPS connection #1225

Improvements

• Early release of rwlock for cached partitions #1181
• Implementation of viewing database and table functionality for system tables #1212
• Remove support for TLS protocol connection on grpc server side #1216
• Modify the starting time precision of buckets to ms #1215
• Support multi-threaded write hinted handoff #1230
• TskvExec partition read strategy #1200
• Added a tool to repair corrupted index files #1238
• Compaction consumes too much memory #1237
• Add host information when querying metrics #1202
• Added metrics information for write_data_in and sql_data_in #1241
• Expired WAL files are not always automatically deleted #1175
• Expired WAL files are not automatically deleted when some Vnodes are "cold" (rarely written to) #1175
• Check for expired WALs and delete them when the cache is flushed to disk #1175
• Optimization of some methods in FileManager #1268

Bug Fixes

• Data loss caused by copying the target Vnode during Vnode migration #1151
• Failed to write data due to metadata verification failure #1184
• Deleting a nonexistent table returns an unexpected status #1218
• Inaccurate monitoring indicators for VNODE_DISK_STORAGE and VNODE_CACHE_SIZE #1197
• System tables cannot query currently executing SQL statements #1188
• Exporting data generates many empty files with only column name information #1211
• Column encoding is not checked when updating tables #1148
• Inconsistent data query results caused by damaged Vnodes #1192
• Writing data fails but still returns success result #1084
• When writing data, a large number of file handles marked as deleted cause continuous disk space growth #1242
• Multiple connections are established when writing data #1251
• Compilation error in CnosDB tuple component in Docker environment #1266
• Fix issue where prom remote_read doesn't return data #1273
• Memory exhaustion when exporting data #955
• Inconsistent or inaccurate query results #1283
• Slow DB recovery after version upgrade #1180
• Syntax parsing error for describe tables and describe databases command #1160
• High memory consumption during data import resulting in OOM and failed data writes #1141
• Incorrect seq_no parameter set during Vnode movement #1175
• SQL execution error "Not a field name" #1033
• External table data import overrides original table data #1131

Behavior Change

• Change the "Table" displayed in the result of show tables to "table_name" #1212

CnosDB v2.3.0已发布。这个版本的主要修改包括：

• 增强了查询功能，现在支持滚动窗口、滑动窗口以及流式计算。
• 对查询迭代器进行了并行化处理，从而极大提升了查询性能。
• 新增了一些问题定位的工具，包括使用 CPU/Memory pprof和异步调用堆栈打印。
• 进一步完善了测试用例系统，包括完善门禁测试用例和增加对SQLLogicTest 的支持。
• 支持 OpenTSDB 写入协议。
• HTTP请求现在支持流式处理方式，有效减少了数据库的内存占用。
• 在企业版本中，增加了订阅和分级存储的支持。欢迎与我们联系。
  此外，还修复了一些 bug。

CnosDB v2.3.0 has been released. The major changes in this version include:

• The query functionality has been strengthened to support tumbling window, sliding window, and stream computing.
• The processing of query iterators has been parallelized, resulting in a significant increase in query performance.
• New problem localization tools have been added, including the use of CPU/Memory pprof and asynchronous call stack printing methods.
• The test case system has been further improved, including enhancing gatekeeper test cases and adding support for SQLLogicTest.
• OpenTSDB write protocol is now supported.
• HTTP requests now support streaming processing, effectively reducing database memory usage.
• In the enterprise version, support for subscription and hierarchical storage has been added. Please feel free to contact us for more information.
  Additionally, a series of bugs have been fixed.

GitHub Repo:
https://github.com/cnosdb/cnosdb
Quick Start Guide：
http:https://docs.cnosdb.com/

CnosDB v2.2.0已发布。这个版本的主要修改包括：

• 支持Prometheus Remote Read/Write API。
• 提高性能：增加索引和文件索引的缓存。
• 重构coordinator和watch的代码，提高性能并增强稳定性。
• 支持多种启动模式： 存算一体、分离和单机模式启动。
• 完善监控metric并增加内存限制以防止oom。
• 完善运维功能，增加copy/move/drop vnode的功能。
• 增加count下推，优化count(*)，大幅提升了count的性能。
• 增加多线程flush，减少写入时内存copy，优化一些锁的使用，提高了写入性能。
  此外，还有一系列bug修复。

CnosDB v2.2.0 has been released. The major changes in this version include:

• Support for the Prometheus Remote Read/Write API.
• Improved performance: added caching for index and file index.
• Refactor the code of Coordinator and Watch to improve performance and enhance stability.
• Support multiple startup modes: storage and computing integration, separation and stand-alone mode start.
• Improved monitoring metrics and added memory limits to prevent OOM.
• Improved the O&M functions, adding copy/move/drop vnode capabilities.
• Added count pushdown, optimized count(*) and significantly improving count performance.
• Add multi-threaded flush, reduce memory copy during writes, optimize the use of some locks and improve write performance.
  In addition, there are a series of bug fixes.

GitHub Repo:
https://github.com/cnosdb/cnosdb
Quick Start Guide：
http:https://docs.cnosdb.com/

我们发布了CnosDB2.0分布式集群版本。这个版本的主要修改包括：

• 新增了支持分布式集群的元数据服务和协调者服务。
• 引入了RBAC权限系统，通过SQL支持用户管理、角色管理和权限管理。
• 重构了倒排索引，解决了索引放大的问题。
• 查询上新增了展示正在执行的query和停掉正在执行的query的功能。
• 统一了对用户的错误码返回，使其更加清晰、简洁。
• 新增了针对多租户场景下的quota支持。
  此外，还包括一系列metric指标和性能优化，以及bug修复等。

We have released version v2.1.0 of CnosDB2.0, a distributed cluster edition. The main modifications in this version include:

• The introduction of meta data service and coordinator service that support distributed clustering.
• The implementation of an RBAC (role-based access control) system that enables user, role, and permission management through SQL.
• A redesign of the inverted index to address index bloating issues.
• The inclusion of a feature that displays both active and terminable queries during searches.
• The unification of error code returns for a more lucid and succinct description of errors.
• The implementation of quota support in scenarios with multiple tenants.
  Additionally, there are a plethora of performance optimizations, bug fixes and metrics included in this version.

GitHub Repo:
https://github.com/cnosdb/cnosdb
Quick Start Guide：
http:https://docs.cnosdb.com/