Reflinks vs symlinks vs hard links, and how they can help machine learning projects

Written by 7genblogger | Published 2019/08/17
Tech Story Tags: machine-learning | linux | operating-systems | git | data-science | artificial-intelligence | latest-tech-stories | reflinks-vs-symlinks

TLDR DVC (Data Version Control) is a tool that can easily rearrange data files quickly and efficiently in machine learning projects. DVC's secret to rearranging data and model files is to link files rather than copy them. Linking a file, like DVC does, is incredibly fast, making it possible to rearrange any amount of files in the blink of an eye, while avoiding copying, thus saving disk space. A new type of link, the Reflink (copy-write), is available in newer releases of Mac OS X and Linux.via the TL;DR App

no story

Written by 7genblogger | A writer and software engineer based in Silicon Valley, focused on machine learning, EV's, Node.js.
Published by HackerNoon on 2019/08/17