Running Presto Engine in a Hybrid Cloud Architecture

Written by bin-fan | Published 2020/07/22
Tech Story Tags: sql | hybrid-cloud | data-engineering | open-source | cloud-computing | hadoop | hdfs | good-company

TLDR Running Presto Engine in a Hybrid Cloud Architecture shows an average of 3x improvement in performance with Alluxio accessing warm data. Presto’s architecture enables the storage and compute components to operate independently. The critical issue in this hybrid environment of Presto in the cloud retrieving HDFS data from an on-premise environment is the network latency between the two clusters. As far as Presto is concerned, it is querying for and writing data to AllUXio as if it were a co-located HDFS cluster.via the TL;DR App

no story

Written by bin-fan | VP of Open Source and Founding Member @Alluxio
Published by HackerNoon on 2020/07/22