Data Science Toolkit (Concepts + Code) source : https://en.wikipedia.org/wiki/Data_science#/media/File:Kernel_Machine.svg Hi folks !! In this post, i will discuss about basic tools and software that one can use to solve a data science problem . If you are new to ML or Data Science or Statistics, Feel free to check out my other blog on ML by clicking on the link below. _Hi, So you want to get started into data science and Ml and don’t know where to start ? What concepts to learn ? Which…_medium.com Machine Learning 101 [Part1] (concepts + Examples) What is a Data Science Toolkit ? Well, Data science toolkit is nothing but a list of functions / modules / packages / frameworks /software that can really help a data scientist to solve a problem. Sometimes you have these functions / packages available in form of 3rd party packages or software and sometimes you are required to create your own. That’s why a True Data Scientist is a mix of ( Statistician and a Programmer ). I am already assuming that you are well verse with Statistics and you have a fair knowledge of Python .[ If not, Then go and learn Stats and programming first :) ] So, Without wasting time lets get started . NOTE : Jupyter Notebook The Jupyter Notebook is an open-source web application that allows you to create and share documents that contain live code, equations, visualizations and narrative text. It is widely used in the data science community. You can download jupyter notebook from the link : . https://jupyter.org/install Image : Jupyter Notebook example Lets look at some of the shortcut command’s of this notebook . : Run the Selected Cells ctrl + Enter Run the current cell and select below shift + Enter: Run the current cell and Insert a new cell below . Alt + Enter : To change the cell type to Markdown M : To change the cell type to Code Y : Insert a cell Above A : Insert a cell below B : Numpy NumPy is the fundamental package for scientific computing with Python. It is very powerful and is widely used in solving data science problems . Lets look at how to use this library with the help of a coding example. The above code is pretty much self-explanatory, I am simply creating a numpy array of 1-dimension and 2-dimensions by passing a list of values in it , checking its data type using dtype method and checking the dimensions of the numpy array using shape method. Then, i am reshaping it using reshape method by passing in the rows and column values i want my array to reshape in. Slicing in numpy array is easily done by using the below syntax: numpy_array[row_to_extract , column_to_extract] or numpy_array[start_row_index:end_row_index,start_col_index:end_col_index] Pandas Pandas is an open- source library providing high-performance, easy-to-use data structures and data analysis tools for the Python. To be honest, It is just like excel or sql but a little advanced and a little better. Lets look at some code examples . you can get the data by clicking on the link below . link: or original source link: https://github.com/karanjagota/MediumBlogs/blob/master/auto.csv https://archive.ics.uci.edu/ml/datasets/auto+mpg Reading Files Output Image Lets look at the three functions i have used in the above code . read_csv : This is used to convert a csv file into a dataframe. head : This is used to find the top 5 rows in the dataset/dataframe . shape : Shape method will return the number of rows and columns of a dataframe. Subsetting: Q1. Extract only those rows where column_name: ‘mpg’ is greater than 30 . Q2. Extract only those rows where column_name: ‘origin’ is equal to ‘Asia’ Q3. Select only top 20 rows of the data/dataframe output: subsetting using loc and iloc methods Lets look at the syntax of above code . loc[] : loc means location and loc method is used to access a group of rows and columns by labels. iloc[]: iloc means index location and iloc method is used to access a group of rows and columns by their indexes. Reshaping DataFrame Output : Implementation of melt() method . DataFrame Converted to vertical format from horizontal format Lets look at the functions used in the above code . DataFrame : It is used to convert a dictionary to a dataframe. melt: This method unpivots a dataframe from wide format to long format, optionally leaving identifier variables set. Combining DataFrames Output Image: Merging DataFrame [1 and 2] Plotly Plotly is a plotting library and is used to plot graphs. It really helps in data visualisation and makes a data scientist job so easy. With plotly, a Data Scientist can visualise the given data in a very very easy way. I recently wrote a post “Data Visualization with plotly (Code)”. Feel free to check it out by clicking on the link below . _Plotly is a great visualization library . It’s opensource and free to some extent and can be used in your next…_medium.com Data Visualization using Plotly (Code) Scikit-Learn / Sklearn Scikit-learn is a free software machine learning library for the Python. It provides a lot of machine learning algorithms with few lines of code. According to me, This library is a blessing to all data scientist. Lets look at a coding example . I hope you liked my post ! If yes, Please, give it a clap. It would encourage me to write more and if you are new to data science, feel free to check out my post on “Descriptive Stats (Concepts + Code )” by clicking on the link below . _Descriptive statistics provide simple summaries about the sample. Such summaries may be either quantitative(summary…_medium.com Descriptive Stats (Concepts + Code) Thanks for reading my post. And don’t forget to Clap, Share and Follow .

Read My Stories

Too Long; Didn't Read

In your car, at home, or at work — Bosch technology shapes many areas of life.

Data Science Toolkit (Concepts + Code)

Too Long; Didn't Read

Company Mentioned

Karan Jagota

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

Data Science Toolkit (Concepts + Code)

Too Long; Didn't Read

Company Mentioned

Karan Jagota

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...

RELATED STORIES