Alluxio

In this blog, you will see how we slashed data ingestion time by half using Hudi and Alluxio. 

Building High-Performance Data Lake Using Apache Hudi and Alluxio 

Reduce HDFS Latency with Alluxio Managed SSD Cache and Presto Consistent Hashing-Based Soft Affinity Scheduling

Speeding Up Uber’s Presto with Alluxio - Part 1

This blog shares how Alluxio has moved to a Zookeeper-less, built-in Raft-based journal system as a HA implementation.

How Alluxio Stores File System State with High Availability, Fault Tolerance

This is a guest blog contributed by datasapiens’ Juraj Pohanka, Koen Michiels and Sam Gilbert. This article described how engineers at datasapiens brought down S3 API costs by 200x by implementing Alluxio as a data orchestration layer between S3 and Presto. 

How To Optimize Large S3 API Costs using Alluxio

This article describes how engineers in the Data Service Center (DSC) at Tencent PCG (Platform and Content Business Group) leverages Alluxio to optimize the analytics performance and minimize the operating costs in building Tencent Beacon Growing, a real-time data analytics platform. 

Accelerating Analytics by 200% with Impala, Alluxio, and HDFS at Tencent

This tutorial shows how Alibaba Cloud Container team runs PyTorch on HDFS using Alluxio under Kubernetes environment. The original Chinese article was published on Alibaba Cloud's engineering blog, then translated and published on Alluxio's Engineering Blog 

Deep Learning at Alibaba Cloud with Alluxio: How To Run PyTorch on HDFS

This article presents the collaboration of Alibaba, Alluxio, and Nanjing University in tackling the problem of Deep Learning model training in the cloud. Various performance bottlenecks are analyzed with detailed optimizations of each component in the architecture. This content was previously published on Alluxio's Engineering Blog, featuring Alibaba Cloud Container Service Team's case study (White Paper here). Our goal was to reduce the cost and complexity of data access for Deep Learning training in a hybrid environment, which resulted in over 40% reduction in training time and cost.

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source

This article describes how Alluxio can accelerate the training of deep learning models in a hybrid cloud environment when using Intel’s Analytics Zoo open source platform, powered by oneAPI. Details on the new architecture and workflow, as well as Alluxio’s performance benefits and benchmarks results will be discussed. The original article can be found on Alluxio's Engineering Blog. 

Alluxio Accelerates Deep Learning in Hybrid Cloud using Intel’s Analytics Zoo powered by oneAPI

In the previous article, I described the concept and design of the Structured Data Service in the Alluxio 2.1.0 release. This article will go through an example to demonstrate how it helps SQL and structured data workloads.

Serving Structured Data in Alluxio: Example

In this article, Thai Bui describes how Bazaarvoice leverages Alluxio as a caching tier on top of  AWS S3 to maximize performance and minimize operating costs on running Big Data analytics on AWS EC2. The original article can be found on Alluxio's engineering blog.  

Accelerate Spark and Hive Jobs on AWS S3 by 10x with Alluxio as a Tiered Storage Solution

This article introduces Structured Data Management (Developer Preview) available in the latest Alluxio 2.1.0 release, a new effort to provide further benefits to SQL and structured data workloads using Alluxio. The original concept was discussed on Alluxio’s engineering blog. This article is part one of the two articles on the Structured Data Management feature my team worked on. 

Serving Structured Data in Alluxio

Learn everything you need to know about Ml via these 242 free HackerNoon stories.

242 Stories To Learn About Ml

Learn everything you need to know about Deep Learning via these 320 free HackerNoon stories.

320 Stories To Learn About Deep Learning

Learn everything you need to know about Tensorflow via these 59 free HackerNoon stories.

59 Stories To Learn About Tensorflow

Learn everything you need to know about Databases via these 121 free HackerNoon stories.

121 Stories To Learn About Databases

Learn everything you need to know about Data Storage via these 49 free HackerNoon stories.

49 Stories To Learn About Data Storage

Learn everything you need to know about Data Engineering via these 96 free HackerNoon stories.

96 Stories To Learn About Data Engineering

Learn everything you need to know about Data Analytics via these 229 free HackerNoon stories.

229 Stories To Learn About Data Analytics

Learn everything you need to know about Big Data Analytics via these 89 free HackerNoon stories.

89 Stories To Learn About Big Data Analytics

Learn everything you need to know about Big Data via these 361 free HackerNoon stories.

361 Stories To Learn About Big Data

Learn everything you need to know about Analytics via these 188 free HackerNoon stories.

188 Stories To Learn About Analytics

Learn everything you need to know about Video Game Development via these 72 free HackerNoon stories.

72 Stories To Learn About Video Game Development

Learn everything you need to know about Game Development via these 223 free HackerNoon stories.

223 Stories To Learn About Game Development

Learn everything you need to know about Uber via these 52 free HackerNoon stories.

52 Stories To Learn About Uber

We are the creators and top committers of Alluxio, formerly Tachyon, and we are revolutionizing the way you store, access, and manage data

ALLUXIO

alluxio.com

32-116 emps

Since 2015

Alluxio's stories on HackerNoon

Building High-Performance Data Lake Using Apache Hudi and Alluxio

Speeding Up Uber’s Presto with Alluxio - Part 1

How Alluxio Stores File System State with High Availability, Fault Tolerance

How To Optimize Large S3 API Costs using Alluxio

Accelerating Analytics by 200% with Impala, Alluxio, and HDFS at Tencent

Deep Learning at Alibaba Cloud with Alluxio: How To Run PyTorch on HDFS

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source

Alluxio Accelerates Deep Learning in Hybrid Cloud using Intel’s Analytics Zoo powered by oneAPI

Serving Structured Data in Alluxio: Example

Accelerate Spark and Hive Jobs on AWS S3 by 10x with Alluxio as a Tiered Storage Solution

Serving Structured Data in Alluxio

242 Stories To Learn About Ml

320 Stories To Learn About Deep Learning

59 Stories To Learn About Tensorflow

121 Stories To Learn About Databases

49 Stories To Learn About Data Storage

96 Stories To Learn About Data Engineering

229 Stories To Learn About Data Analytics

89 Stories To Learn About Big Data Analytics

361 Stories To Learn About Big Data

188 Stories To Learn About Analytics

72 Stories To Learn About Video Game Development

223 Stories To Learn About Game Development

52 Stories To Learn About Uber

Representing this company? Click here to claim and customize this page!

Reviews About Alluxio

Alluxio WIKI

Apply to get your Tech Company News Page live on HackerNoon.com today!

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps