A BIT OF A BACKGROUND Many of you know of my first post on this topic that was back in 2018/2019 when I had just started with my journey which still continues but I have more to share in this update (and I hope you will like it). At that time we had a good number of resources and the divide between and non- related resources were not so to have discussions about — since then things have changed, let’s see what the landscape looks like. Two years in the life of AI, ML, DL and Java Java Java I’m hoping that I’m able to share richer aspects of my journey, views, opinions, observations and learnings this time around as compared to . my previous summary post I do admit that this is only a summary post and I intend to write more specific and focussed posts like the ones I did in 2019 (see the following section) — I have earmarked a couple of topics and I will flesh them out as soon as I’m happy with my selections. 2019: YEAR OF BLOGS Looking at my activities in 2019 towards 2020, I can say I was more focussed on writing blogs and creating a lot of hands-on solution which I shared via my projects on GitHub and blogs on Medium. Here is a list of all of them: August 2019: How to build Graal-enabled JDK8 on CircleCI? August 2019: How to do Deep Learning for Java? September 2019: Running your JuPyTeR notebooks on the cloud October 2019: Running Apache Zeppelin on the cloud November 2019: Applying NLP in Java, all from the command-line November 2019: Exploring NLP concepts using Apache OpenNLP December 2019: Exploring NLP concepts using Apache OpenNLP inside a Java-enabled Jupyter notebook 2020: YEAR OF PRESENTATIONS Similarly in 2020, from a blogging point-of-view I didn’t write much, this officially my first proper post of the year  (with the exception of one in August 2020, which you will find below) — I was quite busy with preparing for talks and presentations and online meetings and discussions. I kicked off the year with my talk at the conference in London, UK. So let me list them here so you can take a look at them in your own time: Grakn Cosmos 2020 February 2020: at conference Naturally, getting productive, my journey with Grakn and Graql Grakn Cosmos 2020 July 2020: at conference “nn” things every Java Developer should know about AI/ML/DL JOnConf 2020 August 2020: on meet up From backend development to machine learning Abhishek Talks(YouTube channel) August 2020: An Interview by Neural Magic: Machine Learning Engineer Spotlight (blog post) October 2020: at the NLP Zurich meet up Profiling Text Data October 2020: at conference Tribuo: an introduction to a Java ML Library MakeITWeek 2020 October 2020: at conference “nn” things every Java Developer should know about AI/ML/DL Oracle Groundbreakers Tour – APAC 2020 You can find slides (and videos of some) of the above presentations under the links provided. OTHER ACHIEVEMENTS AND ACTIVITIES THIS YEAR As to my journey, I have also been involved a good part of this year learning by online AI/ML competitions, see and post shared to learn more. You can also find all of my and for further study. Also the launch of an -based NLP Library called was another important feat for me this year. this this datasets notebooks Python NLP Profiler WHAT’S HAPPENING IN THIS SPACE? There is a lot of hype happening in the space and as rightly said during a conversation sometime back: And I think you will agree with me that we can relate to this situation. Also many of the things we are seeing look nice, and shiny but may NOT be fully ready for the real-world yet, I did cover similar arguments in a . There are few entities who are openly claiming various things about the not-so-bright-sides of AI, they are things like: Suyash Joshi “It’s easy to get sucked into hype and shiny new stuff I fell a lot for that and then get overwhelmed“. post in August (similar to the previous point) the statistical methods used are from the last century and may not be suited to modern day data(led by Nassim Taleb’ s school of thought)many modern-day open-source tools and industry methods to derive at solutions are broken or inadequatewe are not able to explain our predictions and findings(blackbox issue: explainability and interpretability)our AI solutions lack causality, intent and reasoning These come from individuals, groups and companies who are building their own solutions (mostly closed-source) as they have noticed the above drawbacks and doing things to overcome them but also making the rest of the world aware of it. WHERE IS JAVA ON THE MAP? Java has been contributing to the AI force since sometime now, all the way when there was a lot of talk during the Big Data buzz, which then transformed to the new buzz about AI, Machine Learning and Deep Learning. If we closely look at the categories and sub-categories of resources here: Apache Spark [1] | [2] Apache Hadoop and Deeplearning4J many other such tools, libraries, frameworks, and products and now more recently and (from the folks at behind all the ) grCuda graalPython Oracle Labs GraalVM magic DeepNetts Tribuo and more under these resources Java: AI/ML/DL NLP Java Tools and libraries (Java/JVM) some intriguing resources: or | or | or | or | or GitHub AI Artificial Intelligence ML Machine Learning DL Deep Learning RL Reinforcement Learning NLP Natural Language Processing [1] Nvidia and Apache Spark [2] Oracle Labs and Apache Spark You can already see various implementations using Java and other JVM languages — they have just not been noticed by us, unless we made an attempt to look for them. If you have been following the progress of (see ) in this space boosting server-side, desktop and cloud-base systems in terms of performance, ergonomic footprint and language interop — then you will, just like me also see that ’s presence and position is growing from strength-to-strength in this space. GraalVM and Truffle GitHub Java ( grCuda and graalPython are two such examples: see AI/ML/DL related resources on Awesome Graal and also at the appendix sections of  the talk slides for more resources — see section above for talks) SOME HIGHLIGHTS IN PICTURES RECOMMENDED RESOURCES If I had to go through many of the resources I have shared in this post so far, of all of them I would look at these topics (in no particular order and also not an exhaustive list, it’s still a lot of topics to learn and know about): | | | | | | | | | | | | | | | | | | | | | Bayesian Performance in Python Made With ML Virgilio Visualisation TVM: Compiler stack for CPUs, GPUs, etc… Hyperparameter tuning Normalising (and Standardising) a distribution Things to Know grCuda Running compiled and optimised AI Models in the Cloud Neural Magic: Model Pruning and Sparsification Train and Infer models via a native-image Genetic Algorithms by Eyal DeepNetts: Deep Learning in Java by Zoran NLP NLP with Java Graphs ML on Code/Program/Source Code Tribuo: A java-base ML library Chatbots talking to each other Testing My apologies as — I’m working on these topics and slowly gaining knowledge and experience and hence my urge to immediately share them with the rest of the community. I’ll admit few of these may be still — but I hope we can all learn these together. I’ll share more as I make more progress with them during the course of the days, weeks and months into 2021. YMMV Work in Progress CONCLUSIONS We are in a heterogenous space and AI/ML/DL ideas and innovations from creation to deployment go through various forms and shapes and depending on the comfort-zones and end-use cases of the ideas and innovations get implemented using multitudes of technologies. It won’t be correct or fair to say only one technology is being used. We are seeing R&D, rapid prototyping, MVP, PoC and the likes are being done using languages like , , , and the likes while when it comes to robust, reliable, scalable, production-ready solutions more serious contenders are chosen for encapsulating the original work. And and other languages, and the likes that can provide such stability are often being considered both for desktop and cloud implementations. Python R Matlab Julia Java JVM W earing my Oracle Groundbreaker Ambassador hat : I recommend taking advantage of the Free cloud credits from Oracle (also see this post )— the VMs are super fast and easy to setup(see my posts above). WHAT NEXT? The journey continues, the road may be long, but it’s full of learnings — that certainly helps us grow. Many times we learn at the turning points while the milestones keep changing. Let’s continue learning and improving ourselves. Please do feedback if you are curious to explore deeper aspects of what you read above, as you may understand the topic is wide and deep and one post cannot do full justice to such rich topics (plus many of them are moving targets). Previously published at https://www.javaadvent.com/2020/12/another-two-years-in-the-life-of-ai-ml-dl-and-java.html

2 Years In The Life Of AI, ML, DL And Java - Part II

Too Long; Didn't Read

Mani Sarkar

About Author

TOPICS

THIS ARTICLE WAS FEATURED IN...