How We Built A Cross-Region Hybrid Cloud Storage Gateway for ML & AI at WeRide

Written by bin-fan | Published 2020/08/16
Tech Story Tags: self-driving-cars | artificial-intelligence | machine-learning | hybrid-cloud | aws-s3 | data-engineering | open-source | caching

TLDR The original content was published on Alluxio's Engineering Blog (Disclaimer: The author is a Founding Member @Alluxio). In 2020, data on the scale of terabytes is generated daily and we foresee this to grow by a factor of 10 in the following year. WeRide is a globally distributed company with offices located in multiple cities including San Jose in the US and Guangzhou, Beijing, Shanghai, and Anqing in China. The new data access architecture provides a localized cache per location to eliminate redundant requests to S3.via the TL;DR App

no story

Written by bin-fan | VP of Open Source and Founding Member @Alluxio
Published by HackerNoon on 2020/08/16