ClickHouse: Winter/Spring 2020

Author: Alexey Milovidov, 2020-04-04.

ClickHouse: Winter/Spring 2020

Zoom: https://yandex.zoom.us/j/845102379

YouTube: https://www.youtube.com/c/ClickHouseDB

Telegram chat: https://telegram.me/clickhouse_ru, clickhouse_en

Yandex.Eda, promo code: ClickHouse_break
(only for first 100 participants)

ClickHouse Features:
Winter/Spring 2020

In previous episodes:

Tiered Storage DDL queries for dictionaries CONSTRAINTs Prepared Statements Format ORC Format Template ORDER BY optimization WITH FILL text_log metric_log Query Profiler Globs for File/URL/HDFS RPM packages neighbor os_schedule_priority ALTER MODIFY SETTING SELECT FROM VALUES COLUMNS matcher LIVE VIEW Settings constraints Row Level Security Secondary Indices TTL expressions MySQL protocol Adaptive index granularity Advanced text search JSON functions Cascade MATERIALIZED VIEWs WITH ROLLUP/CUBE ASOF JOIN Redis dictionary source Parallel parsing Template format CustomSeparated format VALUES optimization s3 import/export gzip/brotli import/export geoDistance

Role Based Access Control

And also user, access and role management with SQL queries.

CREATE USER / DROP USER

CREATE ROLE / DROP ROLE

GRANT / REVOKE role TO user

GRANT / REVOKE SELECT columns ON db.table TO role/user

Доступно в версии 20.4. Разработчик — Виталий Баранов.

Role Based Access Control

demo?

Non-blocking ALTER Queries

... and ALTER RENAME COLUMN

Доступно в версии 20.4. Разработчик — Александр Сапин.

And More About ALTER

ALTER MATERIALIZE TTL

ALTER MOVE PARTITION

Adaptive Algorithm for JOIN

SET join_algorithm = 'auto'

Automatic switching between Hash Join and Merge Join
depending on memory usage.

Доступно в версии 20.3. Разработчик — Артём Зуйков.

Adaptive Algorithm for JOIN

demo?

DateTime64

Date with time with more than second precision.

DateTime64(3) — milliseconds.

DateTime64(6) — microseconds.

...

Доступно в версии 20.1. Разработчик — Василий Немков, Altinity.

DateTime64

В разработке — расширенный диапазон.

Currently 1970–2106.

Write-Optimized Format of Table Parts

CREATE TABLE test.hits_compact AS test.hits ENGINE = MergeTree ORDER BY ... SETTINGS min_bytes_for_wide_part = '10M'

Speeds up small inserts.

Experimental feature.

Доступно в версии 20.3. Разработчик — Антон Попов.

Write-Optimized Format of Table Parts

demo?

More Features

Avro Format

Regexp Format

Prometheus Handler

Async mode for cache dictionaries

Memory Profiler

system.stack_trace

Network connections limiting

Full h3 support

LTS Versions

Version 20.3 (March 2020) becomes LTS

ClickHouse Playground

(alpha version)

https://play.clickhouse.com/

Runs on the weakest server in Yandex.Cloud.

What's Next

LDAP for authentication

Kerberos for authentication

LDAP for storing rights and roles

What's Next

ALTER RENAME COLUMN

Non-blocking CREATE/DROP/RENAME queries

Buffering and WAL for MergeTree

Cold data storage on top of S3 and HDFS.

Automated builds for FreeBSD x86_64 and Linux ppc64le.

What's Next

Query result caching

Configurable HTTP handlers

Data encryption at rest

Geographical dictionaries

Public roadmap 2020!

https://clickhouse.com/docs/ru/extended_roadmap/

~ 500 задач с подробным описанием — зависимости, исполнители...

63 of them are already done :)

.