(image from bloomberg.com/) Like my articles? Feel free to vote for me as ML Writer of the year here . It takes no political analysis expertise to tell that public opinion is much influenced by and the politicians in public. In this article we have used 30 videos from the two politicians, relatively uniformly spread from January 2020 until today (September 2020), to demonstrate how speech analytics can be used to extract valuable conclusions from such data. what how speak Our goal is to illustrate WHAT and HOW the two candidates have been speaking about during the last year Method : 35 videos from speeches from both candidates (around 2 speeches per month on average) have been used to extract our analytics. Data data were retrieved through Automatic Speech Recognition (ASR). This information will help us to visualize the two candidates talked about. ASR, of course is not totally error-free, the ASR model used in this particular use-case have a word-error-rate around 25% on the particular data. However, in this article we have used simple aggregates to analyze our final texts (such as word clouds), and so the error of this final representation should be much lower. Text what The raw data from the speeches, were analyzed in terms of the speakers and using . In particular, we focused on the speech emotional strength (arousal) and the speech emotional positivity (also known as valence). This second level of analysis will provide a metric on the two candidates have spoken during that period. audio emotions behaviors Behavioral Signals Oliver API how What have they been talking about? First, lets see how the topics the two candidates have discussed can be visualized in a simple across time. word cloud This is Trump's word cloud for some of the months in the selected period (January - September 2020): And this is Biden's: Some conclusions directly drawn from the diagrams above: In the beginning of the year, both candidates' speeches contained a lot of "thank", "god", "bless", "proud" and "folks", probably the context was more "festive" in this period... During the first wave of the crisis in the States (Feb, Mar), Trump used the words "countries" (in the context of comparing USA deaths to other countries statistics), "flu", "coronavirus", "recovered" and "decisions", while Biden focused on words like "crisis", "health", "workers", "public" and "care". COVID-19 After on 25th of May, and during the demonstrations that followed, the two candidates' speeches in June where like this: Biden talked about "justice", "King" (note: Martin Luther obviously), "community", "black", "nation", "police", "violence" and "protest", while Trump about "action", "anarchist", "destruction", "enforcement", "state", "military", "peaceful", "law", "protect" and "property". Floyd's death During the last 3-4 months and , both candidates use their opponents names but Trump uses "Joe" and "Biden" much more frequently than Biden uses "Trump", "Donald" and "President". Also, during that period, Trump uses the words "vaccine", "economic", "depression", "job", "radical", "left" (most of these usually connected to Biden himself). Biden uses "school", "climate", "community", "movement", "job", "promise", "opportunity" and "care". as the elections day is approaching How did they sound? Now let's focus a bit on their tone of voice. We have initially focused on two metrics, namely the . Strength and positivity are two widely used emotional dimensions used in speech emotion recognition (SER) and psychology. For example, according to this emotional representation, anger is strong and negative, sadness is weak and negative and happiness is strong and positive. As described above, we have extracted these two emotional measures by combining outputs. emotional strength and positivity Oliver API Below is the two candidates' emotional graph. strength In both cases, candidates' speeches were more "energetic" in the beginning of the year. Trump's speeches are also becoming with higher emotional energy during the last two months. Also, Biden's emotional energy was minimized during June, which makes sense, if we consider his speeches about Floyd's death (where sadness was the most dominant emotional state). is shown in the next graph: Positivity Again, Biden has the most negative emotions in June and July, while Trump is neutral from March to July and highly positive in the beginning of the year and during the last two months. The graphs above show of emotional strength and positivity. So an extreme case where a candidate would be 50% negative and 50% positive in the same recording would be shown as neutral. For this reason, we may need a third diagram to describe the speakers' emotional state: . This is a measure of emotional fluctuations in the same speech (e.g. going from negative to positive emotion or from angry to happy). The following diagram shows the emotional diversity of the two candidates for all months: averages emotional diversity If we exclude February (i.e. only in 11% of the months), , while for 3 out of the 9 months (34%) the two candidates had both almost zero diversity. in 5 out of the 9 months (55%) Trump had a significantly higher emotional diversity
