ClickHouse® is a free analytics DBMS for big data

Last update: Jan 1, 2023

Overview

ClickHouse® is an open-source column-oriented database management system that allows generating analytical data reports in real time.

Useful Links

Official website has quick high-level overview of ClickHouse on main page.
Tutorial shows how to set up and query small ClickHouse cluster.
Documentation provides more in-depth information.
YouTube channel has a lot of content about ClickHouse in video format.
Slack and Telegram allow to chat with ClickHouse users in real-time.
Blog contains various ClickHouse-related articles, as well as announcements and reports about events.
Code Browser with syntax highlight and navigation.
Contacts can help to get your questions answered if there are any.

Comments

Fix buffer overflow in parser
Changelog category (leave one):

Bug Fix (user-visible misbehavior in official stable or prestable release)

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

A buffer overflow was possible in the parser. Found by fuzzer.

See https://s3.amazonaws.com/clickhouse-test-reports/0/3c64cb26b0b56df648a98f63b0c598f4b1a8fa1a/stateless_tests__release__databasereplicated__[2/2].html

CC @evillique
pr-bugfix
opened by alexey-milovidov 0

Nullptr dereference in parallel replicas.

Describe the bug https://s3.amazonaws.com/clickhouse-test-reports/43772/fa243cf6fbc4a6306789b82b027072ad70067aa5/fast_test.html

2106720:2023.01.07 03:19:45.602391 [ 116895 ] {} <Fatal> BaseDaemon: ########################################
2106721:2023.01.07 03:19:45.602519 [ 116895 ] {} <Fatal> BaseDaemon: (version 22.13.1.1, build id: 6B10C2C008FACFB1E1A1CC81D2E02D059ACC6C66) (from thread 55802) (query_id: b81e032c-eb9e-4887-9231-b33aebb7044f) (query: select count() from pr_t;) Received signal Segmentation fault (11)
2106722:2023.01.07 03:19:45.602565 [ 116895 ] {} <Fatal> BaseDaemon: Address: NULL pointer. Access: read. Unknown si_code.
2106723:2023.01.07 03:19:45.602616 [ 116895 ] {} <Fatal> BaseDaemon: Stack trace: 0x11a03771 0x11992c71 0x119ab007 0x10aab351 0x10d38b4c 0x10d360d6 0x1172d16b 0x1173b099 0x12027ee7 0x120283cd 0x120974c7 0x120950a3 0x7f507de84609 0x7f507e10d133
2106724:2023.01.07 03:19:45.628895 [ 116895 ] {} <Fatal> BaseDaemon: 3.1. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:108: long std::__1::__libcpp_atomic_refcount_increment[abi:v15000]<long>(long&)
2106725:2023.01.07 03:19:45.628924 [ 116895 ] {} <Fatal> BaseDaemon: 3.2. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:169: std::__1::__shared_count::__add_shared[abi:v15000]()
2106726:2023.01.07 03:19:45.628938 [ 116895 ] {} <Fatal> BaseDaemon: 3.3. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:207: std::__1::__shared_weak_count::__add_shared[abi:v15000]()
2106727:2023.01.07 03:19:45.628952 [ 116895 ] {} <Fatal> BaseDaemon: 3.4. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/shared_ptr.h:597: shared_ptr
2106728:2023.01.07 03:19:45.628965 [ 116895 ] {} <Fatal> BaseDaemon: 3. /fasttest-workspace/build/../../ClickHouse/src/Processors/QueryPlan/ReadFromRemote.cpp:337: DB::ReadFromParallelRemoteReplicasStep::initializePipeline(DB::QueryPipelineBuilder&, DB::BuildQueryPipelineSettings const&) @ 0x11a03771 in /fasttest-workspace/build/programs/clickhouse
2106729:2023.01.07 03:19:45.635705 [ 116895 ] {} <Fatal> BaseDaemon: 4. /fasttest-workspace/build/../../ClickHouse/src/Processors/QueryPlan/ISourceStep.cpp:0: DB::ISourceStep::updatePipeline(std::__1::vector<std::__1::unique_ptr<DB::QueryPipelineBuilder, std::__1::default_delete<DB::QueryPipelineBuilder>>, std::__1::allocator<std::__1::unique_ptr<DB::QueryPipelineBuilder, std::__1::default_delete<DB::QueryPipelineBuilder>>>>, DB::BuildQueryPipelineSettings const&) @ 0x11992c71 in /fasttest-workspace/build/programs/clickhouse
2106730:2023.01.07 03:19:45.650679 [ 116895 ] {} <Fatal> BaseDaemon: 5.1. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:302: std::__1::unique_ptr<DB::QueryPipelineBuilder, std::__1::default_delete<DB::QueryPipelineBuilder>>::reset[abi:v15000](DB::QueryPipelineBuilder*)
2106731:2023.01.07 03:19:45.650715 [ 116895 ] {} <Fatal> BaseDaemon: 5.2. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:225: std::__1::unique_ptr<DB::QueryPipelineBuilder, std::__1::default_delete<DB::QueryPipelineBuilder>>::operator=[abi:v15000](std::__1::unique_ptr<DB::QueryPipelineBuilder, std::__1::default_delete<DB::QueryPipelineBuilder>>&&)
2106732:2023.01.07 03:19:45.650733 [ 116895 ] {} <Fatal> BaseDaemon: 5. /fasttest-workspace/build/../../ClickHouse/src/Processors/QueryPlan/QueryPlan.cpp:187: DB::QueryPlan::buildQueryPipeline(DB::QueryPlanOptimizationSettings const&, DB::BuildQueryPipelineSettings const&) @ 0x119ab007 in /fasttest-workspace/build/programs/clickhouse
2106733:2023.01.07 03:19:45.677893 [ 116895 ] {} <Fatal> BaseDaemon: 6. /fasttest-workspace/build/../../ClickHouse/src/Interpreters/InterpreterSelectWithUnionQuery.cpp:380: DB::InterpreterSelectWithUnionQuery::execute() @ 0x10aab351 in /fasttest-workspace/build/programs/clickhouse
2106734:2023.01.07 03:19:45.716447 [ 116895 ] {} <Fatal> BaseDaemon: 7. /fasttest-workspace/build/../../ClickHouse/src/Interpreters/executeQuery.cpp:0: DB::executeQueryImpl(char const*, char const*, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum, DB::ReadBuffer*) @ 0x10d38b4c in /fasttest-workspace/build/programs/clickhouse
2106735:2023.01.07 03:19:45.758053 [ 116895 ] {} <Fatal> BaseDaemon: 8. /fasttest-workspace/build/../../ClickHouse/src/Interpreters/executeQuery.cpp:1104: DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char>> const&, std::__1::shared_ptr<DB::Context>, bool, DB::QueryProcessingStage::Enum) @ 0x10d360d6 in /fasttest-workspace/build/programs/clickhouse
2106736:2023.01.07 03:19:45.788878 [ 116895 ] {} <Fatal> BaseDaemon: 9. /fasttest-workspace/build/../../ClickHouse/src/Server/TCPHandler.cpp:0: DB::TCPHandler::runImpl() @ 0x1172d16b in /fasttest-workspace/build/programs/clickhouse
2106737:2023.01.07 03:19:45.835972 [ 116895 ] {} <Fatal> BaseDaemon: 10. /fasttest-workspace/build/../../ClickHouse/src/Server/TCPHandler.cpp:1952: DB::TCPHandler::run() @ 0x1173b099 in /fasttest-workspace/build/programs/clickhouse
2106738:2023.01.07 03:19:45.837467 [ 116895 ] {} <Fatal> BaseDaemon: 11. /fasttest-workspace/build/../../ClickHouse/contrib/poco/Net/src/TCPServerConnection.cpp:57: Poco::Net::TCPServerConnection::start() @ 0x12027ee7 in /fasttest-workspace/build/programs/clickhouse
2106739:2023.01.07 03:19:45.840030 [ 116895 ] {} <Fatal> BaseDaemon: 12.1. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:48: std::__1::default_delete<Poco::Net::TCPServerConnection>::operator()[abi:v15000](Poco::Net::TCPServerConnection*) const
2106740:2023.01.07 03:19:45.840053 [ 116895 ] {} <Fatal> BaseDaemon: 12.2. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:305: std::__1::unique_ptr<Poco::Net::TCPServerConnection, std::__1::default_delete<Poco::Net::TCPServerConnection>>::reset[abi:v15000](Poco::Net::TCPServerConnection*)
2106741:2023.01.07 03:19:45.840065 [ 116895 ] {} <Fatal> BaseDaemon: 12.3. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/llvm-project/libcxx/include/__memory/unique_ptr.h:259: ~unique_ptr
2106742:2023.01.07 03:19:45.840086 [ 116895 ] {} <Fatal> BaseDaemon: 12. /fasttest-workspace/build/../../ClickHouse/contrib/poco/Net/src/TCPServerDispatcher.cpp:116: Poco::Net::TCPServerDispatcher::run() @ 0x120283cd in /fasttest-workspace/build/programs/clickhouse
2106743:2023.01.07 03:19:45.843075 [ 116895 ] {} <Fatal> BaseDaemon: 13. /fasttest-workspace/build/../../ClickHouse/contrib/poco/Foundation/src/ThreadPool.cpp:213: Poco::PooledThread::run() @ 0x120974c7 in /fasttest-workspace/build/programs/clickhouse
2106744:2023.01.07 03:19:45.845593 [ 116895 ] {} <Fatal> BaseDaemon: 14.1. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/poco/Foundation/include/Poco/SharedPtr.h:156: Poco::SharedPtr<Poco::Runnable, Poco::ReferenceCounter, Poco::ReleasePolicy<Poco::Runnable>>::assign(Poco::Runnable*)
2106745:2023.01.07 03:19:45.845622 [ 116895 ] {} <Fatal> BaseDaemon: 14.2. inlined from /fasttest-workspace/build/../../ClickHouse/contrib/poco/Foundation/include/Poco/SharedPtr.h:208: Poco::SharedPtr<Poco::Runnable, Poco::ReferenceCounter, Poco::ReleasePolicy<Poco::Runnable>>::operator=(Poco::Runnable*)
2106746:2023.01.07 03:19:45.845634 [ 116895 ] {} <Fatal> BaseDaemon: 14. /fasttest-workspace/build/../../ClickHouse/contrib/poco/Foundation/src/Thread_POSIX.cpp:360: Poco::ThreadImpl::runnableEntry(void*) @ 0x120950a3 in /fasttest-workspace/build/programs/clickhouse
2106747:2023.01.07 03:19:45.845662 [ 116895 ] {} <Fatal> BaseDaemon: 15. ? @ 0x7f507de84609 in ?
2106748:2023.01.07 03:19:45.845693 [ 116895 ] {} <Fatal> BaseDaemon: 16. clone @ 0x7f507e10d133 in ?
2106749:2023.01.07 03:19:45.845722 [ 116895 ] {} <Fatal> BaseDaemon: Integrity check of the executable skipped because the reference checksum could not be read.
2106988:2023.01.07 03:20:05.863169 [ 14534 ] {} <Fatal> Application: Child process was terminated by signal 11.

fuzz

opened by alexey-milovidov 0

gRPC to support user-agent header

Can we support user-agent header in gRPC like in http/https? The idea is to log user-agent in system.query_log.http_user_agent.

With ClickHouse/clickhouse-jdbc#1182, when JDBC driver uses http protocol, something like ClickHouse-JdbcDriver/0.4.0-SNAPSHOT (Mac OS X/13.1; OpenJDK 64-Bit Server VM/Temurin-17+35; Apache-HttpClient/5.2.1; rv:f00a176) will be logged in system.query_log. It would be great if we can do the same for gRPC.
feature

opened by zhicwu 0
Fix hash functions for IPv4
Changelog category (leave one):

Bug Fix (user-visible misbehavior in official stable or prestable release)

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Follow-up fix for Replace domain IP types (IPv4, IPv6) with native https://github.com/ClickHouse/ClickHouse/pull/43221
pr-bugfix
opened by yakov-olkhovskiy 0
Fix some missing column exceptions when WITH alias is used with projections
Changelog category (leave one):

Bug Fix (user-visible misbehavior in official stable or prestable release)

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Fix missing column exceptions in some cases when some projection is used together with aliases defined in WITH clause. This fixes https://github.com/ClickHouse/ClickHouse/issues/44963 .

This PR partially reverts https://github.com/ClickHouse/ClickHouse/pull/1088

This PR introduces Backward Incompatible Change . The intermediate block structure may change during distributed processing. So there can be some bumps during rolling upgrade.

Documentation entry for user-facing changes

Information about CI checks: https://clickhouse.com/docs/en/development/continuous-integration/

pr-bugfix
opened by amosbird 0