Originally published at https://www.datacamp.com/community/tutorials/tensorflow-tutorial is a subfield of that is a set of algorithms that is inspired by the structure and function of the brain. Deep learning machine learning TensorFlow is the second machine learning framework that Google created and used to design, build, and train deep learning models.You can use the TensorFlow library do to numerical computations, which in itself doesn’t seem all too special, but these computations are done with data flow graphs. In these graphs, nodes represent mathematical operations, while the edges represent the data, which usually are multidimensional data arrays or tensors, that are communicated between these edges. You see? The name “TensorFlow” is derived from the operations which neural networks perform on multidimensional data arrays or tensors! It’s literally a flow of tensors. For now, this is all you need to know about tensors, but you’ll go deeper into this in the next sections! Today’s TensorFlow tutorial for beginners will introduce you to performing deep learning in an interactive way: You’ll first learn more about ; tensors Then, the tutorial you’ll briefly go over some of the ways that you can on your system so that you’re able to get started and load data in your workspace; install TensorFlow After this, you’ll go over some of the : you’ll see how you can easily get started with simple computations. TensorFlow basics After this, you get started on the real work: you’ll load in data on Belgian traffic signs and it with simple statistics and plotting. exploring In your exploration, you’ll see that there is a need to in such a way that you can feed it to your model. That’s why you’ll take the time to rescale your images and convert them to grayscale. manipulate your data Next, you can finally get started on ! You’ll build up your model layer per layer; your neural network model Once the architecture is set up, you can use it to and to eventually also it by feeding some test data to it. train your model interactively evaluate Lastly, you’ll get some pointers for improvements that you can do to the model you just constructed and how you can continue your learning with TensorFlow. further Download the notebook of this tutorial . here Also, you could be interested in a course on , DataCamp’s or the . Deep Learning in Python Keras tutorial keras with R tutorial Introducing Tensors To understand tensors well, it’s good to have some working knowledge of linear algebra and vector calculus. You already read in the introduction that tensors are implemented in TensorFlow as multidimensional data arrays, but some more introduction is maybe needed in order to completely grasp tensors and their use in machine learning. Before you go into plane vectors, it’s a good idea to shortly revise the concept of “vectors”; Vectors are special types of matrices, which are rectangular arrays of numbers. Because vectors are ordered collections of numbers, they are often seen as column matrices: they have just one column and a certain number of rows. In other terms, you could also consider vectors as scalar magnitudes that have been given a direction. : an example of a scalar is “5 meters” or “60 m/sec”, while a vector is, for example, “5 metres north” or “60 m/sec East”. The difference between these two is obviously that the vector has a direction. Nevertheless, these examples that you have seen up until now might seem far off from the vectors that you might encounter when you’re working with machine learning problems. This is normal; The length of a mathematical vector is a pure number: it is absolute. The direction, on the other hand, is relative: it is measured relative to some reference direction and has units of radians or degrees. You usually assume that the direction is positive and in counterclockwise rotation from the reference direction. Remember Visually, of course, you represent vectors as arrows, as you can see in the picture above. This means that you can consider vectors also as arrows that have direction and length. The direction is indicated by the arrow’s head, while the length is indicated by the length of the arrow. So what about plane vectors then? Plane vectors are the simplest setup of tensors. They are much like regular vectors as you have seen above, with the sole difference that they find themselves in a vector space. To understand this better, let’s start off with an example: you have a vector that is . This means that the vector belongs to the set of real numbers that come paired two at a time. Or, stated differently, they are part of two-space. In such cases, you can represent vectors on the coordinate plane with arrows or rays. 2 X 1 (x,y) Working from this coordinate plane in a standard position where vectors have their endpoint at the origin , you can derive the coordinate by looking at the first row of the vector, while you’ll find the coordinate in the second row. Of course, this standard position doesn’t always need to be maintained: vectors can move parallel to themselves in the plane without experiencing changes. (0,0) x y that similarly, for vectors that are of size , you talk about the three-space. You can represent the vector as a three-dimensional figure with arrows pointing to positions in the vectors pace: they are drawn on the standard , and axes. Note 3 X 1 x y z It’s nice to have these vectors and to represent them on the coordinate plane, but in essence, you have these vectors so that you can perform operations on them and one thing that can help you in doing this is by expressing your vectors as bases or unit vectors. Unit vectors are vectors with a magnitude of one. You’ll often recognize the unit vector by a lowercase letter with a circumflex, or “hat”. Unit vectors will come in convenient if you want to express a 2-D or 3-D vector as a sum of two or three orthogonal components, such as the x− and y−axes, or the z−axis. And when you are talking about expressing one vector, for example, as sums of components, you’ll see that you’re talking about component vectors, which are two or more vectors whose sum is that given vector. : watch , which explains what tensors are with the help of simple household objects! Tip this video Next to plane vectors, also covectors and linear operators are two other cases that all three together have one thing in common: they are specific cases of tensors. You still remember how a vector was characterized in the previous section as scalar magnitudes that have been given a direction. A tensor, then, is the mathematical representation of a physical entity that may be characterized by magnitude and directions. multiple And, just like you represent a scalar with a single number and a vector with sequence of three numbers in a 3-dimensional space, for example, a tensor can be represented by an array of 3R numbers in a 3-dimensional space. The “R” in this notation represents the rank of the tensor: this means that in a 3-dimensional space, a second-rank tensor can be represented by 3 to the power of 2 or 9 numbers. In an N-dimensional space, scalars will still require only one number, while vectors will require N numbers, and tensors will require N^R numbers. This explains why you often hear that scalars are tensors of rank 0: since they have no direction, you can represent them with one number. With this in mind, it’s fairly easy to recognize scalars, vectors, and tensors and to set them apart: scalars can be represented by a single number, vectors by an ordered set of numbers, and tensors by an array of numbers. What makes tensors so special is the combination of components and basis vectors: basis vectors transform one way between reference frames and the components transform in just such a way as to keep the combination between components and basis vectors the same. Installing TensorFlow Now that you know more about TensorFlow, it’s time to get started and install the library. Here, it’s good to know that TensorFlow provides APIs for Python, C++, Haskell, Java, Go, Rust, and there’s also a third-party package for R called . tensorflow : if you want to know more about deep learning packages in R, consider checking out DataCamp’s . Tip keras: Deep Learning in R Tutorial In this tutorial, you will download a version of TensorFlow that will enable you to write the code for your deep learning project in Python. On the , you’ll see some of the most common ways and latest instructions to install TensorFlow using , , Docker and lastly, there are also some of the other ways of installing TensorFlow on your personal computer. TensorFlow installation webpage virtualenv pip You can also install TensorFlow with Conda if you’re working on Windows. However, since the installation of TensorFlow is community supported, it’s best to check the . Note official installation instructions Now that you have gone through the installation process, it’s time to double check that you have installed TensorFlow correctly by importing it into your workspace under the alias : tf import tensorflow as tf that the alias that you used in the line of code above is sort of a convention — It’s used to ensure that you remain consistent with other developers that are using TensorFlow in data science projects on the one hand, and with open-source TensorFlow projects on the other hand. Note Getting Started With TensorFlow: Basics You’ll generally write TensorFlow programs, which you run as a chunk; This is at first sight kind of contradictory when you’re working with Python. However, if you would like, you can also use TensorFlow’s Interactive Session, which you can use to work more interactively with the library. This is especially handy when you’re used to working with IPython. For this tutorial, you’ll focus on the second option: this will help you to get kickstarted with deep learning in TensorFlow. But before you go any further into this, let’s first try out some minor stuff before you start with the heavy lifting. First, import the library under the alias , as you have seen in the previous section. Then initialize two variables that are actually constants. Pass an array of four numbers to the function. tensorflow tf constant() that you could potentially also pass in an integer, but that more often than not, you’ll find yourself working with arrays. As you saw in the introduction, tensors are all about arrays! So make sure that you pass in an array :) Next, you can use to multiply your two variables. Store the result in the variable. Lastly, print out the with the help of the function. Find the exercise . Note multiply() result result print() here that you have defined constants in the DataCamp Light code chunk above. However, there are two other types of values that you can potentially use, namely , which are values that are unassigned and that will be initialized by the session when you run it. Like the name already gave away, it’s just a placeholder for a tensor that will always be fed when the session is run; There are also , which are values that can change. The constants, as you might have already gathered, are values that don’t change. Note placeholders Variables The result of the lines of code is an abstract tensor in the computation graph. However, contrary to what you might expect, the doesn’t actually get calculated; It just defined the model but no process ran to calculate the result. You can see this in the print-out: there’s not really a result that you want to see (namely, 30). This means that TensorFlow has a lazy evaluation! result However, if you do want to see the result, you have to run this code in an interactive session. You can do this in a few ways, as is demonstrated in the DataCamp Light code chunks . below that you can also use the following lines of code to start up an interactive Session, run the and close the Session automatically again after printing the Note result output. In the code chunks you have just defined a default Session, but it’s also good to know that you can pass in options as well. You can, for example, specify the argument and then use the protocol buffer to add configuration options for your session. above config ConfigProto For example, if you add to your Session, you make sure that you log the GPU or CPU device that is assigned to an operation. You will then get information which devices are used in the session for each operation. You could use the following configuration session also, for example, when you use soft constraints for the device placement: . config=tf.ConfigProto(log_device_placement=True) config=tf.ConfigProto(allow_soft_placement=True) Now that you’ve got TensorFlow installed and imported into your workspace and you’ve gone through the basics of working with this package, it’s time to leave this aside for a moment and turn your attention to your data. Just like always, you’ll first take your time to explore and understand your data better before you start modeling your neural network. Belgian Traffic Signs: Background Even though traffic is a topic that is generally known amongst you all, it doesn’t hurt going briefly over the observations that are included in this dataset to see if you understand everything before you start. In essence, in this section, you’ll get up to speed with the domain knowledge that you need to have to go further with this tutorial. Of course, because I’m Belgian, I’ll make sure you’ll also get some anecdotes :) Belgian traffic signs are usually in Dutch and French. This is good to know, but for the dataset that you’ll be working with, it’s not too important! There are six categories of traffic signs in Belgium: warning signs, priority signs, prohibitory signs, mandatory signs, signs related to parking and standing still on the road and, lastly, designatory signs. On January 1st, 2017, more than 30,000 traffic signs were removed from Belgian roads.These were all prohibitory signs relating to speed. Talking about removal, the overwhelming presence of traffic signs has been an ongoing discussion in Belgium (and by extension, the entire European Union). Loading And Exploring The Data Now that you have gathered some more background information, it’s time to download the dataset . You should get the two zip files listed next to “BelgiumTS for Classification (cropped images), which are called “BelgiumTSC_Training” and “BelgiumTSC_Testing”. here : if you have downloaded the files or will do so after completing this tutorial, take a look at the folder structure of the data that you’ve downloaded! You’ll see that the testing, as well as the training data folders, contain 61 subfolders, which are the 62 types of traffic signs that you’ll use for classification in this tutorial. Additionally, you’ll find that the files have the file extension or Portable Pixmap Format. You have downloaded images of the traffic signs! Tip .ppm Let’s get started with importing the data into your workspace. Let’s start with the lines of code that appear below the User-Defined Function (UDF) : load_data() First, set your . This path is the one where you have made the directory with your training and test data. ROOT_PATH Next, you can add the specific paths to your with the help of the function. You store these two specific paths in and . ROOT_PATH join() train_data_directory test_data_directory You see that after, you can call the function and pass in the to it. load_data() train_data_directory Now, the function itself starts off by gathering all the subdirectories that are present in the ; It does so with the help of list comprehension, which is quite a natural way of constructing lists - it basically says that, if you find something in the , you’ll double check whether this is a directory, and if it is one, you’ll add it to your list. that each subdirectory represents a label. load_data() train_data_directory train_data_directory Remember Next, you have to loop through the subdirectories. You first initialize two lists, and . Next, you gather the paths of the subdirectories and the file names of the images that are stored in these subdirectories. After, you can collect the data in the two lists with the help of the function. labels images append() Note that in the , the training and test data are located in folders named “Training” and “Testing”, which are both subdirectories of another directory “TrafficSigns”. On a local machine, this could look something like “/Users/yourName/Downloads/TrafficSigns”, with then two subfolders called “Training” and “Testing”. above code chunk With your data loaded in, it’s time for some data inspection! You can start off with a pretty simple analysis with the help of the and attributes of the array: ndim size images Note that the and variables are lists, so you might need to use to convert the variables to array in your own workspace. This has been done for you ! images labels np.array() here that the that you printed out is in fact one single image that is represented by arrays in arrays! This might seem counterintuitive at first, but it’s something that you’ll get used to as you go further into working with images in machine learning or deep learning applications. Note images[0] Next, you can also take a small look at the , but you shouldn’t see too many surprises . labels at this point These numbers already give you some insights into how successful your import was and the exact size of your data. At first sight, everything has been executed the way you expected it to and you see that the size of the array is considerable if you take into account that you’re dealing with arrays within arrays. try adding the following attributes to your arrays to get mor information about the memory layout, the length of one array element in bytes and the total consumed bytes by the array’s elements with the , and attributes. You can test this out in the IPython console in the DataCamp Light chunk above! Tip flags itemsize nbytes Next, you can also at the distribution of the traffic signs. take a look Awesome job! Now let’s take a closer look at the histogram that you made! You clearly see that not all types of traffic signs are equally represented in the dataset. This is something that you’ll deal with later when you’re manipulating the data before you start modeling your neural network. At first sight, you see that there are labels that are more heavily present in the dataset than others: the labels 22, 32, 38, and 61 definitely jump out. At this point, it’s nice to keep this in mind, but you’ll definitely go further into this in the next section! The previous, small analyses or checks have already given you some idea of the data that you’re working with, but when your data mostly consists of images, the step that you should take to explore your data is by visualizing it. Let’s check out some random traffic signs: First, make sure that you import the module of the package under the common alias . pyplot matplotlib plt Then, you’re going to make a list with 4 random numbers. These will be used to select traffic signs from the array that you have just inspected in the previous section. In this case, you go for , , and . images 300 2250 3650 4000 Next, you’ll say that for every element in the lenght of that list, so from 0 to 4, you’re going to create subplots without axes (so that they don’t go running with all the attention and your focus is solely on the images!). In these subplots, you’re going to show a specific image from the array that is in accordance with the number at the index . In the first loop, you’ll pass to , in the second round , and so on. Lastly, you’ll adjust the subplots so that there’s enough width in between them. images i 300 images[] 2250 The last thing that remains is to show your plot with the help of the function! show() . There you go As you sort of guessed by the 62 labels that are included in this dataset, the signs are different from each other. But what else do you notice? Take another close look at the images below: These four images are not of the same size! You can obviously toy around with the numbers that are contained in the list and follow up more thoroughly on this observation, but be as it may, this is an important observation which you will need to take into account when you start working more towards manipulating your data so that you can feed it to the neural network. traffic_signs Let’s confirm the hypothesis of the differing sizes by printing the shape, the minimum and maximum values of the specific images that you have included into the subplots. heavily resembles the one that you used to create the above plot, but differs in the fact that here, you’ll alternate sizes and images instead of plotting just the images next to each other. The code below how you use the method on the string to fill out the arguments , , and that you defined. Note format() "shape: {0}, min: {1}, max: {2}" {0} {1} {2} Now that you have seen loose images, you might also want to that you printed out in the first steps of your data exploration; You can easily do this by plotting an overview of all the 62 classes and one image that belongs to each class. revisit the histogram that even though you define 64 subplots, not all of them will show images (as there are only 62 labels!). Note also that again, you don’t include any axes to make sure that the readers’ attention doesn’t dwell far from the main topic: the traffic signs! Note As you mostly guessed in the histogram above, there are considerably more traffic signs with labels 22, 32, 38, and 61. This hypothesis is now confirmed in this plot: you see that there are 375 instances with label 22, 316 instances with label 32, 285 instances with label 38 and, lastly, 282 instances with label 61. One of the most interesting questions that you could ask yourself now is whether there’s a connection between all of these instances — maybe all of them are designatory signs? Let’s take a closer look: you see that label 22 and 32 are prohibitory signs, but that labels 38 and 61 are designatory and a prioritory signs, respectively. This means that there’s not an immediate connection between these four, except for the fact that half of the signs that has a heavy presence in the dataset is of the prohibitory kind. Feature Extraction Now that you have thoroughly explored your data, it’s time to get your hands dirty! Let’s recap briefly what you discovered to make sure that you don’t forget any steps in the manipulation: The size of the images was unequal; There are 62 labels or target values (as your labels start at 0 and end at 61); The distribution of the traffic sign values is pretty unequal; There wasn’t really any connection between the signs that were heavily present in the dataset. Now that you have a clear idea of what you need to improve, you can start with manipulating your data in such a way that it’s ready to be fed to the neural network or whichever model you want to feed it to. Let’s start first with extracting some features — you’ll rescale the images and you’ll convert the images that are held in the array to grayscale. You’ll do this color conversion mainly because the color matters less in classification questions like the one you’re trying to answer now. For detection, however, the color does play a big part! So in those cases, it’s not needed to do that conversion! images To tackle the differing image sizes, you’re going to rescale the images; You can easily do this with the help of the or Scikit-Image library, which is a collection of algorithms for image processing. skimage In this case, the module will come in handy, as it offers you a function; You’ll see that you make use of list comprehension (again!) to resize each image to 28 by 28 pixels. Once again, you see that the way you actually form the list: for every image that you find in the array, you’ll perform the transformation operation that you borrow from the library. Finally, you store the result in the variable: transform resize() images skimage images28 # Import the `transform` module from `skimage` from skimage import transform # Rescale the images in the `images` array images28 = [transform.resize(image, (28, 28)) for image in images] This was fairly easy wasn’t it? that the images are now four-dimensional: if you convert to an array and if you concatenate the attribute to it, you’ll see that the printout tells you that ’s dimensions are . The images are 784-dimensional (because your images are 28 by 28 pixels). Note images28 shape images28 (4575, 28, 28, 3) You can check the result of the rescaling operation by re-using the code that you used above to plot the 4 random images with the help of the variable; Just don’t forget to change all references to to . traffic_signs images images28 Check out the result here: that because you rescaled, your and values have also changed; They seem to be all in the same ranges now, which is really great because then you don’t necessarily need to normalize your data! Note min max As said in the introduction to this section of the tutorial, the color in the pictures matters less when you’re trying to answer a classification question. That’s why you’ll also go through the trouble of converting the images to grayscale. , however, that you can also test out on your own what would happen to the final results of your model if you don’t follow through with this specific step. Note Just like with the rescaling, you can again count on the Scikit-Image library to help you out; In this case, it’s the module with its function that you need to use to get where you need to be. color rgb2gray() That’s going to be nice and easy! However, don’t forget to convert the variable back to an array, as the function does expect an array as an argument. images28 rgb2gray() # Import `rgb2gray` from `skimage.color` from skimage.color import rgb2gray # Convert `images28` to an array images28 = np.array(images28) # Convert `images28` to grayscale images28 = rgb2gray(images28) Double check the result of your grayscale conversion by plotting some of the images; , you can again re-use and slightly adapt some of the code to show the adjusted images. Here that you indeed have to specify the color map or and set it to to plot the images in grayscale. That is because by default uses, by default, a heatmap-like color map. Read more . Note cmap "gray" imshow() here : since you have been re-using this function quite a bit in this tutorial, you might look into how you can make it into a function :) Tip These two steps are very basic ones; Other operations that you could have tried out on your data include data augmentation (rotating, blurring, shifting, changing brightness,…). If you want, you could also set up an entire pipeline of data manipulation operations through which you send your images. Deep Learning With TensorFlow Now that you have explored and manipulated your data, it’s time to construct your neural network architecture with the help of the TensorFlow package! Continue to read here . Where To Go Next? If you want to continue working with this dataset and the model that you have put together in this tutorial, try out the following things: Apply regularized LDA on the data before you feed it to your model. This is a suggestion that comes from , written by the researchers that gathered and analyzed this dataset. one of the original papers You could also, as said in the tutorial itself, also look at some other data augmentation operations that you can perform on the traffic sign images. Additionally, you could also try to tweak this network further; The one that you have created now was fairly simple. Early stopping: Keep track of the training and testing error while you train the neural network. Stop training when both errors go down and then suddenly go back up — this is a sign that the neural network has started to overfit the training data. Play around with the optimizers. Make sure to check out the book, written by Nishant Shukla. Machine Learning With TensorFlow also check out the and the . Tip TensorFlow Playground TensorBoard If you want to keep on working with images, definitely check out DataCamp’s , which tackles the MNIST dataset with the help of PCA, K-Means and Support Vector Machines (SVMs). Or take a look at other tutorials such as that use the Belgian traffic signs dataset. scikit-learn tutorial this one Originally published at www.datacamp.com .
