Data Science Toolkit (Concepts + Code) source : https://en.wikipedia.org/wiki/Data_science#/media/File:Kernel_Machine.svg Hi folks !! In this post, i will discuss about basic tools and software that one can use to solve a data science problem . If you are new to ML or Data Science or Statistics, Feel free to check out my other blog on ML by clicking on the link below. Machine Learning 101 [Part1] (concepts + Examples)_Hi, So you want to get started into data science and Ml and don’t know where to start ? What concepts to learn ? Which…_medium.com What is a Data Science Toolkit ? Well, Data science toolkit is nothing but a list of functions / modules / packages / frameworks /software that can really help a data scientist to solve a problem. Sometimes you have these functions / packages available in form of 3rd party packages or software and sometimes you are required to create your own. That’s why a True Data Scientist is a mix of ( Statistician and a Programmer ). NOTE : I am already assuming that you are well verse with Statistics and you have a fair knowledge of Python .[ If not, Then go and learn Stats and programming first :) ] So, Without wasting time lets get started . Jupyter Notebook The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. It is widely used in the data science community. You can download jupyter notebook from the link : https://jupyter.org/install . Image : Jupyter Notebook example Lets look at some of the shortcut command’s of this notebook . ctrl + Enter : Run the Selected Cells
shift + Enter: Run the current cell and select below
Alt + Enter : Run the current cell and Insert a new cell below .
M : To change the cell type to Markdown
Y : To change the cell type to Code
A : Insert a cell Above
B : Insert a cell below Numpy NumPy is the fundamental package for scientific computing with Python. It is very powerful and is widely used in solving data science problems . Lets look at how to use this library with the help of a coding example. The above code is pretty much self-explanatory, I am simply creating a numpy array of 1-dimension and 2-dimensions by passing a list of values in it , checking its data type using dtype method and checking the dimensions of the numpy array using shape method. Then, i am reshaping it using reshape method by passing in the rows and column values i want my array to reshape in. Slicing in numpy array is easily done by using the below syntax: numpy_array[row_to_extract , column_to_extract] or numpy_array[start_row_index:end_row_index,start_col_index:end_col_index] Pandas Pandas is an open- source library providing high-performance, easy-to-use data structures and data analysis tools for the Python. To be honest, It is just like excel or sql but a little advanced and a little better. Lets look at some code examples . you can get the data by clicking on the link below . link: https://github.com/karanjagota/MediumBlogs/blob/master/auto.csv or original source link: https://archive.ics.uci.edu/ml/datasets/auto+mpg Reading Files Output Image Lets look at the three functions i have used in the above code . read_csv : This is used to convert a csv file into a dataframe.
head : This is used to find the top 5 rows in the dataset/dataframe .
shape : Shape method will return the number of rows and columns of a dataframe. Subsetting: Q1. Extract only those rows where column_name: ‘mpg’ is greater than 30 . Q2. Extract only those rows where column_name: ‘origin’ is equal to ‘Asia’ Q3. Select only top 20 rows of the data/dataframe output: subsetting using loc and iloc methods Lets look at the syntax of above code . loc[] : loc means location and loc method is used to access a group of rows and columns by labels.
iloc[]: iloc means index location and iloc method is used to access a group of rows and columns by their indexes. Reshaping DataFrame Output : Implementation of melt() method . DataFrame Converted to vertical format from horizontal format Lets look at the functions used in the above code . DataFrame : It is used to convert a dictionary to a dataframe.
melt: This method unpivots a dataframe from wide format to long format, optionally leaving identifier variables set. Combining DataFrames Output Image: Merging DataFrame [1 and 2] Plotly Plotly is a plotting library and is used to plot graphs. It really helps in data visualisation and makes a data scientist job so easy. With plotly, a Data Scientist can visualise the given data in a very very easy way. I recently wrote a post “Data Visualization with plotly (Code)”. Feel free to check it out by clicking on the link below . Data Visualization using Plotly (Code)_Plotly is a great visualization library . It’s opensource and free to some extent and can be used in your next…_medium.com Scikit-Learn / Sklearn Scikit-learn is a free software machine learning library for the Python. It provides a lot of machine learning algorithms with few lines of code. According to me, This library is a blessing to all data scientist. Lets look at a coding example . I hope you liked my post ! If yes, Please, give it a clap. It would encourage me to write more and if you are new to data science, feel free to check out my post on “Descriptive Stats (Concepts + Code )” by clicking on the link below . Descriptive Stats (Concepts + Code)_Descriptive statistics provide simple summaries about the sample. Such summaries may be either quantitative(summary…_medium.com Thanks for reading my post. And don’t forget to Clap, Share and Follow . Data Science Toolkit (Concepts + Code) source : https://en.wikipedia.org/wiki/Data_science#/media/File:Kernel_Machine.svg https://en.wikipedia.org/wiki/Data_science#/media/File:Kernel_Machine.svg Hi folks !! In this post, i will discuss about basic tools and software that one can use to solve a data science problem . If you are new to ML or Data Science or Statistics, Feel free to check out my other blog on ML by clicking on the link below. Machine Learning 101 [Part1] (concepts + Examples) _Hi, So you want to get started into data science and Ml and don’t know where to start ? What concepts to learn ? Which…_medium.com Machine Learning 101 [Part1] (concepts + Examples) Machine Learning 101 [Part1] (concepts + Examples) _Hi, So you want to get started into data science and Ml and don’t know where to start ? What concepts to learn ? Which…_medium.com What is a Data Science Toolkit ? Well, Data science toolkit is nothing but a list of functions / modules / packages / frameworks /software that can really help a data scientist to solve a problem. Sometimes you have these functions / packages available in form of 3rd party packages or software and sometimes you are required to create your own. That’s why a True Data Scientist is a mix of ( Statistician and a Programmer ). NOTE : I am already assuming that you are well verse with Statistics and you have a fair knowledge of Python .[ If not, Then go and learn Stats and programming first :) ] So, Without wasting time lets get started . NOTE : Jupyter Notebook The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. It is widely used in the data science community. You can download jupyter notebook from the link : https://jupyter.org/install . https://jupyter.org/install Image : Jupyter Notebook example Lets look at some of the shortcut command’s of this notebook . ctrl + Enter : Run the Selected Cells shift + Enter: Run the current cell and select below Alt + Enter : Run the current cell and Insert a new cell below . M : To change the cell type to Markdown Y : To change the cell type to Code A : Insert a cell Above B : Insert a cell below ctrl + Enter : Run the Selected Cells ctrl + Enter shift + Enter: Run the current cell and select below shift + Enter: Alt + Enter : Run the current cell and Insert a new cell below . Alt + Enter : M : To change the cell type to Markdown M : Y : To change the cell type to Code Y : A : Insert a cell Above A : B : Insert a cell below B : Numpy NumPy is the fundamental package for scientific computing with Python. It is very powerful and is widely used in solving data science problems . Lets look at how to use this library with the help of a coding example. The above code is pretty much self-explanatory, I am simply creating a numpy array of 1-dimension and 2-dimensions by passing a list of values in it , checking its data type using dtype method and checking the dimensions of the numpy array using shape method. Then, i am reshaping it using reshape method by passing in the rows and column values i want my array to reshape in. Slicing in numpy array is easily done by using the below syntax: numpy_array[row_to_extract , column_to_extract] or numpy_array[start_row_index:end_row_index,start_col_index:end_col_index] numpy_array[row_to_extract , column_to_extract] or numpy_array[start_row_index:end_row_index,start_col_index:end_col_index] Pandas Pandas is an open- source library providing high-performance, easy-to-use data structures and data analysis tools for the Python. To be honest, It is just like excel or sql but a little advanced and a little better. Lets look at some code examples . you can get the data by clicking on the link below . link: https://github.com/karanjagota/MediumBlogs/blob/master/auto.csv or original source link: https://archive.ics.uci.edu/ml/datasets/auto+mpg https://github.com/karanjagota/MediumBlogs/blob/master/auto.csv https://archive.ics.uci.edu/ml/datasets/auto+mpg Reading Files Output Image Lets look at the three functions i have used in the above code . read_csv : This is used to convert a csv file into a dataframe. head : This is used to find the top 5 rows in the dataset/dataframe . shape : Shape method will return the number of rows and columns of a dataframe. read_csv : This is used to convert a csv file into a dataframe. head : This is used to find the top 5 rows in the dataset/dataframe . shape : Shape method will return the number of rows and columns of a dataframe. Subsetting: Subsetting: Q1. Extract only those rows where column_name: ‘mpg’ is greater than 30 . Q2. Extract only those rows where column_name: ‘origin’ is equal to ‘Asia’ Q3. Select only top 20 rows of the data/dataframe output: subsetting using loc and iloc methods Lets look at the syntax of above code . loc[] : loc means location and loc method is used to access a group of rows and columns by labels. iloc[]: iloc means index location and iloc method is used to access a group of rows and columns by their indexes. loc[] : loc means location and loc method is used to access a group of rows and columns by labels. iloc[]: iloc means index location and iloc method is used to access a group of rows and columns by their indexes. Reshaping DataFrame Output : Implementation of melt() method . DataFrame Converted to vertical format from horizontal format Lets look at the functions used in the above code . DataFrame : It is used to convert a dictionary to a dataframe. melt: This method unpivots a dataframe from wide format to long format, optionally leaving identifier variables set. DataFrame : It is used to convert a dictionary to a dataframe. melt: This method unpivots a dataframe from wide format to long format, optionally leaving identifier variables set. Combining DataFrames Output Image: Merging DataFrame [1 and 2] Plotly Plotly is a plotting library and is used to plot graphs. It really helps in data visualisation and makes a data scientist job so easy. With plotly, a Data Scientist can visualise the given data in a very very easy way. I recently wrote a post “Data Visualization with plotly (Code)”. Feel free to check it out by clicking on the link below . Data Visualization using Plotly (Code) _Plotly is a great visualization library . It’s opensource and free to some extent and can be used in your next…_medium.com Data Visualization using Plotly (Code) Data Visualization using Plotly (Code) _Plotly is a great visualization library . It’s opensource and free to some extent and can be used in your next…_medium.com Scikit-Learn / Sklearn Scikit-learn is a free software machine learning library for the Python. It provides a lot of machine learning algorithms with few lines of code. According to me, This library is a blessing to all data scientist. Lets look at a coding example . I hope you liked my post ! If yes, Please, give it a clap. It would encourage me to write more and if you are new to data science, feel free to check out my post on “Descriptive Stats (Concepts + Code )” by clicking on the link below . Descriptive Stats (Concepts + Code) _Descriptive statistics provide simple summaries about the sample. Such summaries may be either quantitative(summary…_medium.com Descriptive Stats (Concepts + Code) Descriptive Stats (Concepts + Code) _Descriptive statistics provide simple summaries about the sample. Such summaries may be either quantitative(summary…_medium.com Thanks for reading my post. And don’t forget to Clap, Share and Follow .

Probability for Machine Learning

Relational Databases (Designing Schema & Writing a Query)

Read My Stories

Too Long; Didn't Read

Make resilience your competitive advantage

Data Science Toolkit (Concepts + Code)

About Author

Comments

TOPICS

THIS ARTICLE WAS FEATURED IN

Related Stories

Untitled Story

7 Programming Concepts Everyone Should Know (With Code)

What Are Convolution Neural Networks? [ELI5]

The Noonification: Have U Been Pwned? (1/12/2023)

Goldman Sachs, Data Lineage, and Harry Potter Spells

People are still crazy about Python after twenty-five years

7 Programming Concepts Everyone Should Know (With Code)

What Are Convolution Neural Networks? [ELI5]

The Noonification: Have U Been Pwned? (1/12/2023)

Goldman Sachs, Data Lineage, and Harry Potter Spells

People are still crazy about Python after twenty-five years

Light-Mode

Classic

Newspaper

Dark-Mode

Neon Noir

Minty

HN StartUps