Trade Crypto with Machine Learning Based On Google Trends

Google trends (GT) is an under-utilized superweapon and harvests a massive amount of search data. But, it hasn't been possible to use GT for real time machine learning tasks, such as , until now.... In this blog, we'll explain with GT for machine learning, to GT data and we've built in crypto trading models at . We are currently looking for as beta testers for our product - please reach out to ! Edgebase.io is a no-code platform for building your own AI trading signals (initially cryptos only). predicting stock price or crypto currency movements the problem the fix the edge edgebase.io experienced crypto traders hello@edgebase.io What's the problem? Let's assume you want to test whether Google trends keywords, such as "bitcoin", are leading indicators of the price movement for BTCUSD on the . You'll need an method to grab for building ML models and the equivalent to evaluate those models and make predictions. Easy. Not quite. Kraken Exchange historical data real time data GT gives different results across different time windows: Bitcoin for past 30 days on 26th April 2021 Bitcoin for past 90 days on 26th April 2021 we can see that the "interest over time" of for the past 30 days and the past 90 days . Looking back 30 days, the value on 23rd April 2021 is , whereas looking back 90 days the value on 23rd April is . Above "bitcoin" 100 76 Google trends considers the search volume within a time window. In the past 90 days, the day with the highest search counts was February 9th 2021 and thus the 23rd April gets reduced from 100 to 71. because historical GT data cannot align with new real time data. relative This is a problem for machine learning In fact, the problem is even worse! GT also uses a of the true search count. Even if we query within the same date range, . A group of German researchers made headlines in 2020, when they published a showing huge discrepancies for "kurzarbeit", the German word for placing workers on partial furlough. This was particularly concerning because German politicans were actively using "kurzarbeit" GT data for setting policy during the coronavirus pandemic. sample the results can suffer from huge variances due to small sample sizes paper What's the fix? Our fix at is to use our proprietary correction algorithm for GT data. Starting from a 'seed date', we iteratively track changes in the GT reindexing and correct any reindexing over time. This means that different GT sample windows can be stitched together and provide a consistent view of the relative search count over time. We also correct for low sample sizes in GT data, by taking multiple samples from the same time window and creating an average sample using the . The sample error reduces by a factor of , where is the number of GT queries taken for the same window. edgebase.io magic of the central limit theorem sqrt(n) n Google doesn't provide daily data beyond 90 days, and if you try to stitch together rolling 30 day windows of "bitcoin" GT data you get: there are many peaks in search volume, some do correspond to bitcoin movements, but this is very noisy and unreliable data. However, if you use the you get: Above edgebase correction algorithm Visually, you can see that our correction has significantly less spikes at 100, closely follows the Bitcoin price and scales over time. But can this be used to predict bitcoin price movements... What's the edge? At we quickly train ML models with new datasets, such as our new corrected GT bitcoin data . Let's start with a simple bitcoin price model. We can drag and drop datasets and create features off these dataset using the Edgebase model builder. In the example , we take the 11 daily log difference of our new "Bitcoin" GT data and use it to predict the daily bitcoin closing price: edgebase.io at scale below Kraken Now we have constructed our simple model, let's hit "Train Model": Pretty impressive! The is 52, which means we predicted the bitcoin price movement about 52% of the time. Our profit is about 40% over 3 months and our Sharpe ratio is 1.24, which approximately means we earned 1.24 units of reward for every unit of trading risk taken. We can improve the model by feeding the logarithmic 3 day (weighted) difference of bitcoin prices into our model as well: F1 score Even better ! The is still 52, but with a slightly improved Sharpe ratio of 2.12 and higher returns at 75%: F1 score This is only one dataset we provide to predict cryptocurrencies at . We also have volume data, futures data and other proprietary datasets for bitcoin, Ethereum, dogecoin and other altcoins. Thank you for reading and if you are an please reach out to as we are looking for beta testing users! edgebase.io experienced crypto trader hello@edgebase.io