Alluxio

In this blog, you will see how we slashed data ingestion time by half using Hudi and Alluxio. 

Building High-Performance Data Lake Using Apache Hudi and Alluxio 

Reduce HDFS Latency with Alluxio Managed SSD Cache and Presto Consistent Hashing-Based Soft Affinity Scheduling

Speeding Up Uber’s Presto with Alluxio - Part 1

This blog shares how Alluxio has moved to a Zookeeper-less, built-in Raft-based journal system as a HA implementation.

How Alluxio Stores File System State with High Availability, Fault Tolerance

This is a guest blog contributed by datasapiens’ Juraj Pohanka, Koen Michiels and Sam Gilbert. This article described how engineers at datasapiens brought down S3 API costs by 200x by implementing Alluxio as a data orchestration layer between S3 and Presto. 

How To Optimize Large S3 API Costs using Alluxio

This article describes how engineers in the Data Service Center (DSC) at Tencent PCG (Platform and Content Business Group) leverages Alluxio to optimize the analytics performance and minimize the operating costs in building Tencent Beacon Growing, a real-time data analytics platform. 

Accelerating Analytics by 200% with Impala, Alluxio, and HDFS at Tencent

This tutorial shows how Alibaba Cloud Container team runs PyTorch on HDFS using Alluxio under Kubernetes environment. The original Chinese article was published on Alibaba Cloud's engineering blog, then translated and published on Alluxio's Engineering Blog 

Deep Learning at Alibaba Cloud with Alluxio: How To Run PyTorch on HDFS

This article presents the collaboration of Alibaba, Alluxio, and Nanjing University in tackling the problem of Deep Learning model training in the cloud. Various performance bottlenecks are analyzed with detailed optimizations of each component in the architecture. This content was previously published on Alluxio's Engineering Blog, featuring Alibaba Cloud Container Service Team's case study (White Paper here). Our goal was to reduce the cost and complexity of data access for Deep Learning training in a hybrid environment, which resulted in over 40% reduction in training time and cost.

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source

This article describes how Alluxio can accelerate the training of deep learning models in a hybrid cloud environment when using Intel’s Analytics Zoo open source platform, powered by oneAPI. Details on the new architecture and workflow, as well as Alluxio’s performance benefits and benchmarks results will be discussed. The original article can be found on Alluxio's Engineering Blog. 

Alluxio Accelerates Deep Learning in Hybrid Cloud using Intel’s Analytics Zoo powered by oneAPI

In the previous article, I described the concept and design of the Structured Data Service in the Alluxio 2.1.0 release. This article will go through an example to demonstrate how it helps SQL and structured data workloads.

Serving Structured Data in Alluxio: Example

In this article, Thai Bui describes how Bazaarvoice leverages Alluxio as a caching tier on top of  AWS S3 to maximize performance and minimize operating costs on running Big Data analytics on AWS EC2. The original article can be found on Alluxio's engineering blog.  

Accelerate Spark and Hive Jobs on AWS S3 by 10x with Alluxio as a Tiered Storage Solution

This article introduces Structured Data Management (Developer Preview) available in the latest Alluxio 2.1.0 release, a new effort to provide further benefits to SQL and structured data workloads using Alluxio. The original concept was discussed on Alluxio’s engineering blog. This article is part one of the two articles on the Structured Data Management feature my team worked on. 

Serving Structured Data in Alluxio

Learn everything you need to know about Ml via these 242 free HackerNoon stories.

242 Stories To Learn About Ml

We are the creators and top committers of Alluxio, formerly Tachyon, and we are revolutionizing the way you store, access, and manage data

ALLUXIO

alluxio.com

32-116 emps

Since 2015

ALLUXIO

EVERGREEN INDEX #11440

Alluxio's stories on HackerNoon

Building High-Performance Data Lake Using Apache Hudi and Alluxio

Speeding Up Uber’s Presto with Alluxio - Part 1

How Alluxio Stores File System State with High Availability, Fault Tolerance

How To Optimize Large S3 API Costs using Alluxio

Accelerating Analytics by 200% with Impala, Alluxio, and HDFS at Tencent

Deep Learning at Alibaba Cloud with Alluxio: How To Run PyTorch on HDFS

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source

Alluxio Accelerates Deep Learning in Hybrid Cloud using Intel’s Analytics Zoo powered by oneAPI

Serving Structured Data in Alluxio: Example

Accelerate Spark and Hive Jobs on AWS S3 by 10x with Alluxio as a Tiered Storage Solution

Serving Structured Data in Alluxio

242 Stories To Learn About Ml

Alluxio's Related Companies

Representing this company? Click here to claim and customize this page!

Reviews About Alluxio

Alluxio WIKI

Apply to get your Tech Company News Page live on HackerNoon.com today!

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps

ALLUXIO

alluxio.com

32-116 emps

Since 2015

ALLUXIO

EVERGREEN INDEX #11440

Alluxio's stories on HackerNoon

Building High-Performance Data Lake Using Apache Hudi and Alluxio

Speeding Up Uber’s Presto with Alluxio - Part 1

How Alluxio Stores File System State with High Availability, Fault Tolerance

How To Optimize Large S3 API Costs using Alluxio

Accelerating Analytics by 200% with Impala, Alluxio, and HDFS at Tencent

Deep Learning at Alibaba Cloud with Alluxio: How To Run PyTorch on HDFS

Efficient Model Training in the Cloud with Kubernetes, TensorFlow, and Alluxio Open Source

Alluxio Accelerates Deep Learning in Hybrid Cloud using Intel’s Analytics Zoo powered by oneAPI

Serving Structured Data in Alluxio: Example

Accelerate Spark and Hive Jobs on AWS S3 by 10x with Alluxio as a Tiered Storage Solution

Serving Structured Data in Alluxio

242 Stories To Learn About Ml

Alluxio's Related Companies

2014

22.8B

-0.3%

2016

16.8B

2017

15B

2011

13B

2017

13B

2021

12B

Representing this company? Click here to claim and customize this page!

Reviews About Alluxio

Alluxio WIKI

Apply to get your Tech Company News Page live on HackerNoon.com today!

Light-Mode

Classic

Newspaper

Minty

Dark-Mode

Neon Noir

Minty

HN StartUps