Accelerating Analytics by 200% with Impala, Alluxio, and HDFS at Tencent

Written by bin-fan | Published 2020/07/11
Tech Story Tags: data-analytics | open-source | sql | distributed-systems | caching | performance | hdfs | good-company

TLDR Tencent's Beacon Growing is an analytics platform that provides insights of user behaviors in realtime. Beacon comes with both built-in and customized analytic models, such as RETENT, FUNNEL, PATH, etc. Using Alluxio as a distributed caching layer, the HDFS scanning performance for Impala queries is accelerated by 2x out of the box without further optimization. With faster data retrieval, I/O-intensive queries are sped up by 244% with a median improvement of 121% across all queries.via the TL;DR App
no story
Written by bin-fan | VP of Open Source and Founding Member @Alluxio
Published by HackerNoon on 2020/07/11
ABOUTHow hackers start their afternoons. We publish tech stories and build publishing software.

READEntirely free library read by hundreds of millions to learn anything about any technology.

WRITEHackerNoon elevates quality technology writing far and wide across the interwebs.

PARTNERHackerNoon works directly with tech companies to place ads by content relevancy