Create a Twitter Politician Bot with Markov Chains, Node.js and StdLib

In the world’s current political climate, propaganda is the name of the game and Twitter is the medium of choice. Automation is king, and if you’re not using bots to sway the masses, you’re doing it wrong. Here at , we don’t really have any political motivations, but we sure do enjoy building bots. And, with the launch of , it’s never been easier for us to share our newest project with you: introducing Jaden Trudeau, the eccentric future Prime Minister of Canada. We’ll teach you all about how we built this wonder of modern engineering, and how you can build your own “Political Terminator” (shoutout to Arnie) in minutes. Twitter StdLib StdLib Sourcecode With the goal of building a Twitter bot build to appeal to the masses, we chose to combine the wisdom of Jaden Smith: With the wholesomeness of Justin Trudeau: To create the world’s perfect politician: Jaden Trudeau. More specifically, the goal is to create a bot that occasionally tweets procedurally generated sentences in the style of Jaden Smith and Justin Trudeau. This combination results in wonderful specimens such as: The of choice is for this project is a Markov chain: Markov chains have many real world applications like Google’s Page Rank algorithm, but none are as important as this one. If you want to skip to the working version of the code, you can checkout its API page . From this page you can try the service yourself, and even mix in other peoples Twitters! tool here Coming to an election near you — Jaden Trudeau What’s the deal with Markov Chains? We describe a Markov chain as follows: We have a set of states, = { }. The process starts in one of these states and moves successively from one state to another. Each move is called a step. If the chain is currently in state , then it moves to state at the next step with a probability denoted by and this probability does not depend upon which states the chain was in before the current. [ ] S s_₁, s_₂,…,s_r s_i s_j p_ij, source A two state Markov chain [ ] source In short, a Markov chain is a mathematical model that transitions from one state to another by throwing out the history of previous states and only examining the present. While that explanation is still bit abstract, it becomes more clear within the context of generating sentences. Below is an outline for how you might generate text using a Markov chain. Split a body of text (your corpus) into tokens (words and punctuation). Build a frequency table. This data structure has a key for every unique token in your corpus. This key is mapped to a list of all the words that follow the key, along with the frequency at which it occurs after that word. It also helps to add special keys for the start and end of sentences. This ensures that when sampling from the model you can always start and end sentences with appropriate words. Select a starting point (one of those special start words) and then randomly select a token from the list of tokens that follow the key. The probability that a key is chosen should be proportional to how often it appears after the key. This new token is now the state of the Markov chain. Lookup the new token in the frequency table and repeat. Implementation With a general idea of how to proceed, it’s time to get going. First things first, we need to fetch some tweets. With , thats no problem. Twit After receiving the tweets, they need to be tokenized. With tweets, this is not an entirely trivial process. Tweets are full of URLs, emojis and ill formed sentences. We can turn a string representing a tweet into an array of tokens with the code below: This function takes in a tweet, strips it of URLs and mentions and splits it into words. These arrays can then be feed into the frequency table. The code to generate the table is a little long for a medium post, but you can see it . After the table is generated, entries look like this: here These entries could be traversed in a few ways. At the beginning, there is a 50/50 change of selecting ‘ ’ or ‘ ’ as the starting word. Assuming ‘ ’ gets chosen then there is a 2/5 chance that ‘ ’ or ‘ ’ gets chosen and a 1/5 chance for ‘ ’. This process keeps repeating until a chain is created such as: our we our future differences relationship __START -> our -> future -> office -> __END And that’s pretty much it. If you want to see it in action, follow on Twitter. Of cource, there are many tweaks that can be made. For instance, if you want to generate multiple sentences at a time you can add edges from to , and just make sure that you end with a complete sentence. Jaden Trudeau __END __START Building Your Own If you’d like to build your own Twitter bot, you can check out the sourcecode (you can even deploy a bot directly from the browser!). When you navigate to the page you’ll find a button labeled “Create Service from Source”. When clicked you’ll be prompted for some environment variables. here Environment variables for the Twitter bot The first one is a StdLib library token, which you can leave as is. The other four are can be found on your page. Click “Create an App” and fill out the form: Twitter application management Twitter application management page After you click “Create”, you’ll find the four keys on the next page. Copy them into the prompt and click “Deploy”. In order to see the code locally and make changes you need our , which you can get it from by opening up your terminal and running: CLI NPM npm install lib.cli -g And now create a StdLib workspace and get the code you just deployed: $ mkdir stdlib-workspace$ cd stdlib-workspace$ lib init$ lib get /twitter-bot By default this bot uses the Markov chain to generate tweets. If you wanted to swap that out for another method, you could open and make a small change: __main__.js Main function for the Twitter bot On line 12 there is a call to , which the Markov chain from earlier. You can play with it directly from the . You can create your own function that generates tweets and simply swap it in. Now to deploy the bot again you just run lib.steve[twitter-markov-chain] StdLib library docs page $ lib release And that’s it, thanks for reading! Hopefully you were able to learn a little bit about Markov chains, Twitter bots and StdLib. Building a propaganda machine is just one of the many ways you can get started with StdLib. If you have a neat idea you’d like to share, reach out to me directly by e-mail: , or follow and the team on Twitter. steven@stdlib.com me StdLib As always, we look forward to hearing from you and happy building! Steve Meyer is a recent graduate of Oberlin College and Software Engineer at StdLib . When he’s not programming you can find him cooking, baking, or playing Breath of the Wild.