Alluxio

In this blog, you will see how we slashed data ingestion time by half using Hudi and Alluxio. 

Building High-Performance Data Lake Using Apache Hudi and Alluxio 

Reduce HDFS Latency with Alluxio Managed SSD Cache and Presto Consistent Hashing-Based Soft Affinity Scheduling

Speeding Up Uber’s Presto with Alluxio - Part 1

This blog shares how Alluxio has moved to a Zookeeper-less, built-in Raft-based journal system as a HA implementation.

How Alluxio Stores File System State with High Availability, Fault Tolerance

This is a guest blog contributed by datasapiens’ Juraj Pohanka, Koen Michiels and Sam Gilbert. This article described how engineers at datasapiens brought down S3 API costs by 200x by implementing Alluxio as a data orchestration layer between S3 and Presto. 

How To Optimize Large S3 API Costs using Alluxio

This article describes how engineers in the Data Service Center (DSC) at Tencent PCG (Platform and Content Business Group) leverages Alluxio to optimize the analytics performance and minimize the operating costs in building Tencent Beacon Growing, a real-time data analytics platform. 

Accelerating Analytics by 200% with Impala, Alluxio, and HDFS at Tencent

This tutorial shows how Alibaba Cloud Container team runs PyTorch on HDFS using Alluxio under Kubernetes environment. The original Chinese article was published on Alibaba Cloud's engineering blog, then translated and published on Alluxio's Engineering Blog 

Deep Learning at Alibaba Cloud with Alluxio: How To Run PyTorch on HDFS

This article presents the collaboration of Alibaba, Alluxio, and Nanjing University in tackling the problem of Deep Learning model training in the cloud. Various performance bottlenecks are analyzed with detailed optimizations of each component in the architecture. This content was previously published on Alluxio's Engineering Blog, featuring Alibaba Cloud Container Service Team's case study (White Paper here). Our goal was to reduce the cost and complexity of data access for Deep Learning training in a hybrid environment, which resulted in over 40% reduction in training time and cost.

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source

This article describes how Alluxio can accelerate the training of deep learning models in a hybrid cloud environment when using Intel’s Analytics Zoo open source platform, powered by oneAPI. Details on the new architecture and workflow, as well as Alluxio’s performance benefits and benchmarks results will be discussed. The original article can be found on Alluxio's Engineering Blog. 

Alluxio Accelerates Deep Learning in Hybrid Cloud using Intel’s Analytics Zoo powered by oneAPI

We are the creators and top committers of Alluxio, formerly Tachyon, and we are revolutionizing the way you store, access, and manage data

ALLUXIO

alluxio.com

employees

Since n.d.

COMPANY RANKING

ALLUXIO

EVERGREEN INDEX #4720

Representing this company? Click here to claim and customize this page!

Read More Tech Stories Related to #Alluxio

Alluxio WIKI

Apply to get your Tech Company News Page live on HackerNoon.com today!

ALLUXIO

alluxio.com

employees

Since n.d.

COMPANY RANKING

ALLUXIO

EVERGREEN INDEX #4720

RELATED COMPANIESRANK

HACKERNOON STORIES ON ALLUXIO

Representing this company? Click here to claim and customize this page!

Read More Tech Stories Related to #Alluxio

Alluxio WIKI

Apply to get your Tech Company News Page live on HackerNoon.com today!