While reading @madzadev ‘s article "9 Open Source Projects Every Developer Needs to Bookmark for Their Workflow", I realized how useful it would be to create a similar list specifically for data scientists/analysts. Inspired by that idea, I’ve put together a list of open-source projects designed to make our workflows faster, data processes smoother, and maybe even spark some fresh ideas. This list includes both well-known tools and a few hidden gems that have big potential. I hope you may find something that’s helpful and inspiring for you. Leeet’s dive in! 🚀🚀 1. Streamlit - Interactive Dashboards 🐍 Streamlit is an open-source Python library for creating interactive web-based data applications quickly and easily. Thanks to their community, you can also use templates or ask your questions. 👨‍💻 GitHub Repository: Streamlit Repository 🌍 Website: https://streamlit.io/ 2. Superset - Data Visualization and Exploration 📈 Apache Superset is an open-source, highly customizable bi-tool ideal for us, offering SQL-based exploration and integration with various databases, but requires more technical expertise. In contrast, tableau, powerbi, and Data Studio provide user-friendly interfaces, advanced analytics, and ready-to-use features for non-technical users, though they come with licensing costs (except Data Studio, which is free 💰 ) 👨‍💻 GitHub Repository: Superset Repository 🌍 Website: https://superset.apache.org/ 3. DVC - Versioning for ML Projects 👩🏻‍💻 DVC brings git-like functionality to datasets and machine learning models, making projects more reproducible and manageable. They also have a perfect technical guide and community for themselves. 👨‍💻 GitHub Repository: DVC Repository 🌍 Website: https://dvc.org/ 4. Great Expectations - Data Validation and Documentation 📃 Great Expectations is your go-to tool for making sure your data is clean, reliable, and ready to use. It automates data validation with customizable tests, so you can catch issues before they become problems. If you care about data quality and trust in your analysis, this tool is a game changer. 👨‍💻 GitHub Repository: Great Expectations Repository 🌍 Website: https://greatexpectations.io/ 5. Dask - Parallel Computing With Python 🐍 Dask is like Pandas and Numpy on steroids, built for handling massive datasets that don’t fit in memory. It’s perfect for scaling your data tasks, whether you’re working on your laptop or a big cluster. If you need speed and power without learning a whole new tool, Dask has got you covered. 👨‍💻 GitHub Repository: Dask Repository 🌍 Website: https://www.dask.org/ 6.  Haystack – Build Search Systems With NLP 🔍 Haystack is your go-to tool for creating intelligent search and question-answering systems. It lets you connect LLMs and other NLP models to your own data, making it perfect for building domain-specific applications. Whether it’s semantic search or document retrieval, Haystack gives you the tools to get it done efficiently. 👨‍💻 GitHub Repository: Haystack Repository 🌍 Website: https://haystack.deepset.ai/ 7. Logseq - Open Source Knowledge Management 📚 Logseq is an open-source tool that feels like a digital brain for organizing your notes, tasks, and ideas. It’s built around a clean outliner and bi-directional linking, making it perfect for connecting thoughts and tracking your workflows. If you love structure and flexibility in your knowledge management, Logseq is a must-try. 👨‍💻GitHub Repository: Logseq Repository 🌍 Website: https://logseq.com/ Thank you for your time; sharing is caring! 🌍 While reading @madzadev ‘s article "9 Open Source Projects Every Developer Needs to Bookmark for Their Workflow" , I realized how useful it would be to create a similar list specifically for data scientists/analysts. Inspired by that idea, I’ve put together a list of open-source projects designed to make our workflows faster, data processes smoother, and maybe even spark some fresh ideas. This list includes both well-known tools and a few hidden gems that have big potential. @madzadev "9 Open Source Projects Every Developer Needs to Bookmark for Their Workflow" "9 Open Source Projects Every Developer Needs to Bookmark for Their Workflow" I hope you may find something that’s helpful and inspiring for you. Leeet’s dive in! 🚀🚀 1. Streamlit - Interactive Dashboards 🐍 1. Streamlit - Interactive Dashboards Streamlit is an open-source Python library for creating interactive web-based data applications quickly and easily. Thanks to their community, you can also use templates or ask your questions. Streamlit 👨‍💻 GitHub Repository : Streamlit Repository GitHub Repository Streamlit Repository 🌍 Website: https://streamlit.io/ Website: https://streamlit.io/ 2. Superset - Data Visualization and Exploration 📈 2. Superset - Data Visualization and Exploration 📈 Apache Superset is an open-source, highly customizable bi-tool ideal for us, offering SQL-based exploration and integration with various databases, but requires more technical expertise. In contrast, tableau, powerbi, and Data Studio provide user-friendly interfaces, advanced analytics, and ready-to-use features for non-technical users, though they come with licensing costs (except Data Studio, which is free 💰 ) Apache Superset 👨‍💻 GitHub Repository : Superset Repository GitHub Repository Superset Repository 🌍 Website: https://superset.apache.org/ Website: https://superset.apache.org/ 3. DVC - Versioning for ML Projects 👩🏻‍💻 3. DVC - Versioning for ML Projects 👩🏻‍💻 DVC brings git-like functionality to datasets and machine learning models, making projects more reproducible and manageable. They also have a perfect technical guide and community for themselves. DVC 👨‍💻 GitHub Repository : DVC Repository GitHub Repository DVC Repository 🌍 Website: https://dvc.org/ Website: https://dvc.org/ 4. Great Expectations - Data Validation and Documentation 📃 4. Great Expectations is your go-to tool for making sure your data is clean, reliable, and ready to use. It automates data validation with customizable tests, so you can catch issues before they become problems. If you care about data quality and trust in your analysis, this tool is a game changer. Great Expectations 👨‍💻 GitHub Repository : Great Expectations Repository GitHub Repository Great Expectations Repository 🌍 Website: https://greatexpectations.io/ Website: https://greatexpectations.io/ 5. Dask - Parallel Computing With Python 🐍 5. Dask - Parallel Computing With Python 🐍 Dask is like Pandas and Numpy on steroids, built for handling massive datasets that don’t fit in memory. It’s perfect for scaling your data tasks, whether you’re working on your laptop or a big cluster. If you need speed and power without learning a whole new tool, Dask has got you covered. Dask 👨‍💻 GitHub Repository : Dask Repository GitHub Repository Dask Repository 🌍 Website: https://www.dask.org/ Website: https://www.dask.org/ 6.  Haystack – Build Search Systems With NLP 🔍 Haystack is your go-to tool for creating intelligent search and question-answering systems. It lets you connect LLMs and other NLP models to your own data, making it perfect for building domain-specific applications. Whether it’s semantic search or document retrieval, Haystack gives you the tools to get it done efficiently. 👨‍💻 GitHub Repository : Haystack Repository GitHub Repository Haystack Repository 🌍 Website : https://haystack.deepset.ai/ Website 7. Logseq - Open Source Knowledge Management 📚 7. Logseq - Open Source Knowledge Management 📚 Logseq is an open-source tool that feels like a digital brain for organizing your notes, tasks, and ideas. It’s built around a clean outliner and bi-directional linking, making it perfect for connecting thoughts and tracking your workflows. If you love structure and flexibility in your knowledge management, Logseq is a must-try. Logseq 👨‍💻 GitHub Repository : Logseq Repository GitHub Repository Logseq Repository 🌍 Website: https://logseq.com/ Website: https://logseq.com/ Thank you for your time; sharing is caring! 🌍 Thank you for your time; sharing is caring! 🌍

Walkthroughs, tutorials, guides, and tips. This story will teach you how to do something new or how to do something better.

Hot off the press! This story contains factual information about a recent event.

This story contains new, firsthand information uncovered by the writer.

Apache

GitHub

Superset

7 Open Source Projects Every Data Scientist/Analyst Needs to Bookmark 🚀

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

A Well-intentioned Cashback Program Caused an Increase in Fraud—Here's What Happened

104 Stories To Learn About Go

105 Stories To Learn About Functional Programming

100+ Free Pluralsight Courses to learn Python, Java, and Spring Boot

10 Websites to Learn JavaScript for Beginners

104 Stories To Learn About Programming Top Story

A Well-intentioned Cashback Program Caused an Increase in Fraud—Here's What Happened

104 Stories To Learn About Go

105 Stories To Learn About Functional Programming

100+ Free Pluralsight Courses to learn Python, Java, and Spring Boot

10 Websites to Learn JavaScript for Beginners

104 Stories To Learn About Programming Top Story

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps