iLert is a software for alerting, on-call management and uptime monitoring and helps DevOps teams to respond faster incidents and increase uptime

iLert

Notes from the Underground by Fyodor Dostoyevsky is part of the HackerNoon Books Series. You can jump to any chapter in this book here . Part I. Underground - XI Part I. Underground - XI The long and the short of it is, gentlemen, that it is better to do nothing! Better conscious inertia! And so hurrah for underground! Though I have said that I envy the normal man to the last drop of my bile, yet I should not care to be in his place such as he is now (though I shall not cease envying him). No, no; anyway the underground life is more advantageous. There, at any rate, one can ... Oh, but even now I am lying! I am lying because I know myself that it is not underground that is better, but something different, quite different, for which I am thirsting, but which I cannot find! Damn underground! I will tell you another thing that would be better, and that is, if I myself believed in anything of what I have just written. I swear to you, gentlemen, there is not one thing, not one word of what I have written that I really believe. That is, I believe it, perhaps, but at the same time I feel and suspect that I am lying like a cobbler. “Then why have you written all this?” you will say to me. “I ought to put you underground for forty years without anything to do and then come to you in your cellar, to find out what stage you have reached! How can a man be left with nothing to do for forty years?” “Isn’t that shameful, isn’t that humiliating?” you will say, perhaps, wagging your heads contemptuously. “You thirst for life and try to settle the problems of life by a logical tangle. And how persistent, how insolent are your sallies, and at the same time what a scare you are in! You talk nonsense and are pleased with it; you say impudent things and are in continual alarm and apologising for them. You declare that you are afraid of nothing and at the same time try to ingratiate yourself in our good opinion. You declare that you are gnashing your teeth and at the same time you try to be witty so as to amuse us. You know that your witticisms are not witty, but you are evidently well satisfied with their literary value. You may, perhaps, have really suffered, but you have no respect for your own suffering. You may have sincerity, but you have no modesty; out of the pettiest vanity you expose your sincerity to publicity and ignominy. You doubtlessly mean to say something, but hide your last word through fear, because you have not the resolution to utter it, and only have a cowardly impudence. You boast of consciousness, but you are not sure of your ground, for though your mind works, yet your heart is darkened and corrupt, and you cannot have a full, genuine consciousness without a pure heart. And how intrusive you are, how you insist and grimace! Lies, lies, lies!” Of course I have myself made up all the things you say. That, too, is from underground. I have been for forty years listening to you through a crack under the floor. I have invented them myself, there was nothing else I could invent. It is no wonder that I have learned it by heart and it has taken a literary form.... But can you really be so credulous as to think that I will print all this and give it to you to read too? And another problem: why do I call you “gentlemen,” why do I address you as though you really were my readers? Such confessions as I intend to make are never printed nor given to other people to read. Anyway, I am not strong-minded enough for that, and I don’t see why I should be. But you see a fancy has occurred to me and I want to realise it at all costs. Let me explain. Every man has reminiscences which he would not tell to everyone, but only to his friends. He has other matters in his mind which he would not reveal even to his friends, but only to himself, and that in secret. But there are other things which a man is afraid to tell even to himself, and every decent man has a number of such things stored away in his mind. The more decent he is, the greater the number of such things in his mind. Anyway, I have only lately determined to remember some of my early adventures. Till now I have always avoided them, even with a certain uneasiness. Now, when I am not only recalling them, but have actually decided to write an account of them, I want to try the experiment whether one can, even with oneself, be perfectly open and not take fright at the whole truth. I will observe, in parenthesis, that Heine says that a true autobiography is almost an impossibility, and that man is bound to lie about himself. He considers that Rousseau certainly told lies about himself in his confessions, and even intentionally lied, out of vanity. I am convinced that Heine is right; I quite understand how sometimes one may, out of sheer vanity, attribute regular crimes to oneself, and indeed I can very well conceive that kind of vanity. But Heine judged of people who made their confessions to the public. I write only for myself, and I wish to declare once and for all that if I write as though I were addressing readers, that is simply because it is easier for me to write in that form. It is a form, an empty form—I shall never have readers. I have made this plain already ... I don’t wish to be hampered by any restrictions in the compilation of my notes. I shall not attempt any system or method. I will jot things down as I remember them. But here, perhaps, someone will catch at the word and ask me: if you really don’t reckon on readers, why do you make such compacts with yourself—and on paper too—that is, that you won’t attempt any system or method, that you jot things down as you remember them, and so on, and so on? Why are you explaining? Why do you apologise? Well, there it is, I answer. There is a whole psychology in all this, though. Perhaps it is simply that I am a coward. And perhaps that I purposely imagine an audience before me in order that I may be more dignified while I write. There are perhaps thousands of reasons. Again, what is my object precisely in writing? If it is not for the benefit of the public why should I not simply recall these incidents in my own mind without putting them on paper? Quite so; but yet it is more imposing on paper. There is something more impressive in it; I shall be better able to criticise myself and improve my style. Besides, I shall perhaps obtain actual relief from writing. Today, for instance, I am particularly oppressed by one memory of a distant past. It came back vividly to my mind a few days ago, and has remained haunting me like an annoying tune that one cannot get rid of. And yet I must get rid of it somehow. I have hundreds of such reminiscences; but at times some one stands out from the hundred and oppresses me. For some reason I believe that if I write it down I should get rid of it. Why not try? Besides, I am bored, and I never have anything to do. Writing will be a sort of work. They say work makes man kind-hearted and honest. Well, here is a chance for me, anyway. Snow is falling today, yellow and dingy. It fell yesterday, too, and a few days ago. I fancy it is the wet snow that has reminded me of that incident which I cannot shake off now. And so let it be a story à propos of the falling snow. About HackerNoon Book Series: We bring you the most important technical, scientific, and insightful public domain books. This book is part of the public domain. Fyodor Dostoyevsky (1996). Notes from the Underground. Urbana, Illinois: Project Gutenberg. Retrieved October https://www.gutenberg.org/cache/epub/600/pg600-images.html This eBook is for the use of anyone anywhere at no cost and with almost no restrictions whatsoever. You may copy it, give it away or re-use it under the terms of the Project Gutenberg License included with this eBook or online at www.gutenberg.org , located at https://www.gutenberg.org/policy/license.html.

Better conscious inertia!

On Dextaxation

You think that being stuck is a permanent state, and this is the pattern you go through every time: You encounter a new challenge.
Your brain resists it.
It hasn’t been trained to handle discomfort effectively.
You revert to what’s comfortable and familiar.
You shut yourself off from potential growth and enlightenment.
You feel stuck, unfulfilled and unhappy. When you face the challenge of feeling stagnant in your career, in your personal life, nothing seems to help you progress. You feel not just stuck, but regressing. The worst part of it was that in some strange way, it also feels “comfortable” being stuck. I’m sure you have that feeling, because we are wired the same way, and so do I. I wanted to understand why we are so resistant to change, to discomfort. Why is it that it’s easier for us to stay in situations we don’t like while we know damn well it’s not the right path. Why is change hard? Why makes hard things hard? Well, I got some answers while reading a research paper from computational neurobiologist Andrew Gallimore. I finally got a better understanding of how our brain constructs reality, how it cheats us by wanting to save energy, and how we can hack it. 1. Understanding Our Brain: A Reality-Building Machine I won’t bore you with the very technical research paper filled with complicated words and never ending sentences. Here’s a breakdown for you: Central to this process are the cortical columns, functional units within the cerebral cortex that orchestrate your perception of the world. These columns evaluate sensory information against your brain’s existing models, determining “True” or “False” signals to guide your reactions and beliefs. To put this even simpler, They work like little decision-makers in the outer layer of the brain, sorting through what we see and feel. They check this information against what the brain already knows, deciding if it matches (“True”) or doesn’t match (“False”). This helps you figure out how to react and what to believe. Here’s the problem: Your brain and its cortical columns are designed to conserve energy at all costs. This means they’re constantly seeking “True” statements, those that align with what you already know and believe. Why? Because processing familiar information requires less energy than assimilating new data. This is precisely why staying in your comfort zones feels so… comfortable. It’s not just inertia; it’s a battle against a highly efficient computer in your head, always seeking stability over the chaos of change. Your gut might scream for a shift, but you’re up against your brain’s design, which chooses energy conservation over everything else. 2. The Mannequin Misidentification: A Cortex in Action Ok ben, that sounds cool and I get the theory. But how does this actualise, and how is it shaping my reality? Here’s an example: Imagine walking down a street, your eyes catch what appears to be a figure standing in a shop window. Your brain utilizes past data, and quickly categorizes this figure as a man — a “True” response rooted in familiarity. You continue to walk closer, until something happens.. you realize that the figure is not a person, but in fact a mannequin. This unexpected twist sends a “False” signal to your brain, specifically to those cortical columns tasked with visual processing. Faced with this new information, your brain recalibrates, updating your reality from a man to a mannequin. 3. Embracing the Science of Uncomfortability So there we have it. The path to growth is through embracing “False” signals — those challenging, unfamiliar experiences that demand our brain to adjust and grow. This process isn’t just about acquiring new information; it’s about fundamentally reshaping our perception and interaction with the world around us. It’s about changing reality; literally asking your cortex to re-evaluate your current reality, and change it. That’s why it feels so hard. That’s why it feels so weirdly good to stay stuck. So, what are some steps to hack this? 4. Recognizing the State of “Brain Automation” Well, first, you need to understand when you’re stuck in “brain automation”. I’m sure you know this feeling very well. You’re in that state when you go through your daily routines without much thought or variation. You wake up, get dressed, get coffee at the same spot, order the same drink. Tasks and activities feel mundane, and you’re not engaged or stimulated by what you’re doing. You are bored. You wake up every morning saying “ok here we go, another day doing the same thing until I get to go to sleep again. Let’s just get through it with as many distractions as possible.” Nothing seems to make you feel alive. You are just in automation mode. Activities that used to hold your attention don’t mean anything anymore. 5. Breaking Through with Challenging Thoughts Now that you recognize the signs of “brain automation,” the next step isn’t just about what you do; it’s about how you think. Changing your actions without changing your thoughts is like repainting your car when it needs a new engine. Sure, it will look good on the outside, it still won’t run though. So do this: Ask why, and don’t judge. “Why” is such a short but powerful question that can almost always be used successively until the truth is met: “I feel stuck in my career? Why? …Because I don’t like what I do. Why? …Because it doesn’t challenge me or align with my values. Why? …Because I settled into a role that was available rather than pursuing what genuinely interests me. Why? …Because I fear the uncertainty of change and the possibility of failure. Why? …Because past experiences have conditioned me to prioritize security over fulfillment. Why? …Because I internalized the belief that success is defined by stability rather than personal satisfaction and growth.” Take this and keep asking the same question. You’ll get to the root of it soon enough. In this instance, your feeling of being stuck is less about the external circumstances and more about internal barriers — fears, beliefs, and assumptions that keep you tethered to the familiar, however unsatisfying it may be. 6. No, but really.. How do I get unstuck? Listen. True transformation begins when you push beyond the boundaries of what you know and where you’re comfortable. The shift needs to happen in your head, but also physically. You need to consciously and repetitively seek out “False” signals and embrace the discomfort they bring. You need to construct a new reality. In plain, simple terms, you need to: do the uncomfortable thing. Here are a few of the things I have had to do last week alone that finally led me to break out of my cycle: I impulssively bought a plane ticket to Panama, to change my enviroment, create some space for me to:
Sit with my feelings for the first time in years, and finally stop supressing them. I cried. Haven’t done that in years.
I had the uncomfortable conversation with my business partner to tell them I no longer have passion for it and am leaving them the decision to continue or quit.
I made the decision to get a therapist and seek help to access past trauma that I’ve burried deep down.
I replied "I don't know" when asked about something I was unsure of, rather than trying to appear confident. I felt stupid that instant, but I actually learned something and ended up having a meaninful conversation.
I forced myself to talk to strangers every single day. Oh, and talking happened to be in Spanish, for which my vocabulary consisted of a total of 40 words or so. These things were uncomfortable. These things were all dreadful for me. They are supposed to be. They are hard, they are counter-intuitive, and they are painful. But if you don’t do them, you are letting your cortex run on auto-pilot, validating a “true” statement that will feel comfortable. Yes, in the immediate short term, it feels better. But you are reinforcing your mind into shaping the wrong reality. Do that long enough, and you will soon be living in a world that is not yours. You’ll have a job you hate, relationships that don’t support you, a deep lack of purpose, numbing yourself to the world around you until you become nothing more than a ghost, aimlessly drifting through a suffocating and meaningless existence. Waking up to it 10 years later will be very painful. So Wake up. Challenge yourself. Engineer your existence and break free. You think that being stuck is a permanent state, and this is the pattern you go through every time: You encounter a new challenge. Your brain resists it. It hasn’t been trained to handle discomfort effectively. You revert to what’s comfortable and familiar. You shut yourself off from potential growth and enlightenment. You feel stuck, unfulfilled and unhappy. You encounter a new challenge. Your brain resists it. It hasn’t been trained to handle discomfort effectively. You revert to what’s comfortable and familiar. You shut yourself off from potential growth and enlightenment. You feel stuck, unfulfilled and unhappy. When you face the challenge of feeling stagnant in your career, in your personal life, nothing seems to help you progress. You feel not just stuck, but regressing. The worst part of it was that in some strange way, it also feels “comfortable” being stuck. I’m sure you have that feeling, because we are wired the same way, and so do I. I wanted to understand why we are so resistant to change, to discomfort. Why is it that it’s easier for us to stay in situations we don’t like while we know damn well it’s not the right path. Why is change hard? Why makes hard things hard? Well, I got some answers while reading a research paper from computational neurobiologist Andrew Gallimore. I finally got a better understanding of how our brain constructs reality, how it cheats us by wanting to save energy, and how we can hack it. 1. Understanding Our Brain: A Reality-Building Machine I won’t bore you with the very technical research paper filled with complicated words and never ending sentences. Here’s a breakdown for you: Central to this process are the cortical columns, functional units within the cerebral cortex that orchestrate your perception of the world. These columns evaluate sensory information against your brain’s existing models, determining “True” or “False” signals to guide your reactions and beliefs. To put this even simpler, They work like little decision-makers in the outer layer of the brain, sorting through what we see and feel. They check this information against what the brain already knows, deciding if it matches (“True”) or doesn’t match (“False”). This helps you figure out how to react and what to believe. Here’s the problem: Your brain and its cortical columns are designed to conserve energy at all costs. This means they’re constantly seeking “True” statements, those that align with what you already know and believe. Why? Because processing familiar information requires less energy than assimilating new data. This is precisely why staying in your comfort zones feels so… comfortable. It’s not just inertia; it’s a battle against a highly efficient computer in your head, always seeking stability over the chaos of change. Your gut might scream for a shift, but you’re up against your brain’s design, which chooses energy conservation over everything else. 2. The Mannequin Misidentification: A Cortex in Action Ok ben, that sounds cool and I get the theory. But how does this actualise, and how is it shaping my reality? Here’s an example: Imagine walking down a street, your eyes catch what appears to be a figure standing in a shop window. Your brain utilizes past data, and quickly categorizes this figure as a man — a “True” response rooted in familiarity. You continue to walk closer, until something happens.. you realize that the figure is not a person, but in fact a mannequin. This unexpected twist sends a “False” signal to your brain, specifically to those cortical columns tasked with visual processing. Faced with this new information, your brain recalibrates, updating your reality from a man to a mannequin. 3. Embracing the Science of Uncomfortability So there we have it. The path to growth is through embracing “False” signals — those challenging, unfamiliar experiences that demand our brain to adjust and grow. This process isn’t just about acquiring new information; it’s about fundamentally reshaping our perception and interaction with the world around us. It’s about changing reality; literally asking your cortex to re-evaluate your current reality, and change it. That’s why it feels so hard. That’s why it feels so weirdly good to stay stuck. So, what are some steps to hack this? 4. Recognizing the State of “Brain Automation” Well, first, you need to understand when you’re stuck in “brain automation”. I’m sure you know this feeling very well. You’re in that state when you go through your daily routines without much thought or variation. You wake up, get dressed, get coffee at the same spot, order the same drink. Tasks and activities feel mundane, and you’re not engaged or stimulated by what you’re doing. You are bored. You wake up every morning saying “ ok here we go, another day doing the same thing until I get to go to sleep again. Let’s just get through it with as many distractions as possible .” ok here we go, another day doing the same thing until I get to go to sleep again. Let’s just get through it with as many distractions as possible Nothing seems to make you feel alive. You are just in automation mode. Activities that used to hold your attention don’t mean anything anymore. 5. Breaking Through with Challenging Thoughts Now that you recognize the signs of “brain automation,” the next step isn’t just about what you do; it’s about how you think. Changing your actions without changing your thoughts is like repainting your car when it needs a new engine. Sure, it will look good on the outside, it still won’t run though. So do this: Ask why, and don’t judge. “Why” is such a short but powerful question that can almost always be used successively until the truth is met: “I feel stuck in my career? Why? “I feel stuck in my career? Why? …Because I don’t like what I do. Why? …Because I don’t like what I do. Why? …Because it doesn’t challenge me or align with my values. Why? …Because it doesn’t challenge me or align with my values. Why? …Because I settled into a role that was available rather than pursuing what genuinely interests me. Why? …Because I settled into a role that was available rather than pursuing what genuinely interests me. Why? …Because I fear the uncertainty of change and the possibility of failure. Why? …Because I fear the uncertainty of change and the possibility of failure. Why? …Because past experiences have conditioned me to prioritize security over fulfillment. Why? …Because past experiences have conditioned me to prioritize security over fulfillment. Why? …Because I internalized the belief that success is defined by stability rather than personal satisfaction and growth.” …Because I internalized the belief that success is defined by stability rather than personal satisfaction and growth.” Take this and keep asking the same question. You’ll get to the root of it soon enough. In this instance, your feeling of being stuck is less about the external circumstances and more about internal barriers — fears, beliefs, and assumptions that keep you tethered to the familiar, however unsatisfying it may be. 6. No, but really.. How do I get unstuck? Listen. True transformation begins when you push beyond the boundaries of what you know and where you’re comfortable. The shift needs to happen in your head, but also physically. You need to consciously and repetitively seek out “False” signals and embrace the discomfort they bring. You need to construct a new reality. In plain, simple terms, you need to: do the uncomfortable thing . do the uncomfortable thing Here are a few of the things I have had to do last week alone that finally led me to break out of my cycle: I impulssively bought a plane ticket to Panama, to change my enviroment, create some space for me to: Sit with my feelings for the first time in years, and finally stop supressing them. I cried. Haven’t done that in years. I had the uncomfortable conversation with my business partner to tell them I no longer have passion for it and am leaving them the decision to continue or quit. I made the decision to get a therapist and seek help to access past trauma that I’ve burried deep down. I replied "I don't know" when asked about something I was unsure of, rather than trying to appear confident. I felt stupid that instant, but I actually learned something and ended up having a meaninful conversation. I forced myself to talk to strangers every single day. Oh, and talking happened to be in Spanish, for which my vocabulary consisted of a total of 40 words or so. I impulssively bought a plane ticket to Panama, to change my enviroment, create some space for me to: Sit with my feelings for the first time in years, and finally stop supressing them. I cried. Haven’t done that in years. I had the uncomfortable conversation with my business partner to tell them I no longer have passion for it and am leaving them the decision to continue or quit. I made the decision to get a therapist and seek help to access past trauma that I’ve burried deep down. I replied "I don't know" when asked about something I was unsure of, rather than trying to appear confident. I felt stupid that instant, but I actually learned something and ended up having a meaninful conversation. I forced myself to talk to strangers every single day. Oh, and talking happened to be in Spanish, for which my vocabulary consisted of a total of 40 words or so. These things were uncomfortable. These things were all dreadful for me. They are supposed to be. They are hard, they are counter-intuitive, and they are painful. But if you don’t do them, you are letting your cortex run on auto-pilot, validating a “true” statement that will feel comfortable. Yes, in the immediate short term, it feels better. But you are reinforcing your mind into shaping the wrong reality . wrong reality wrong reality Do that long enough, and you will soon be living in a world that is not yours. You’ll have a job you hate, relationships that don’t support you, a deep lack of purpose, numbing yourself to the world around you until you become nothing more than a ghost, aimlessly drifting through a suffocating and meaningless existence. Waking up to it 10 years later will be very painful. So Wake up. Challenge yourself. Engineer your existence and break free.

The Illusion of Being Stuck

আটকে থাকার বিভ্রম

Die Illusion, festzustecken

La ilusión de estar estancado

L'illusion d'être coincé

फँस जाने का भ्रम

行き詰まっているという幻想

갇혀 있다는 환상

A ilusão de estar preso

Иллюзия застревания

Sıkışmış Olma Yanılsaması

Ảo tưởng bị mắc kẹt

陷入困境的错觉

Moving Beyond Self-Esteem For Self-Fulfilment 

স্ব-পরিপূর্ণতার জন্য স্ব-সম্মান অতিক্রম করা

Über das Selbstwertgefühl hinausgehen und sich selbst verwirklichen

Más allá de la autoestima para la realización personal

Aller au-delà de l’estime de soi pour l’épanouissement personnel

आत्म-संतुष्टि के लिए आत्म-सम्मान से आगे बढ़ना

自己実現のために自尊心を超える

자존감을 넘어 자기 실현을 위해

Indo além da autoestima para a autorrealização

Выход за пределы самооценки ради самореализации

Kendini Gerçekleştirmek İçin Benlik Saygısının Ötesine Geçmek

Vượt lên trên lòng tự trọng để hoàn thiện bản thân

超越自尊，实现自我价值

Newton’s Laws in Society: How Social Forces Move Physical Bodies

সমাজে নিউটনের আইন: সামাজিক শক্তিগুলি কীভাবে শারীরিক দেহগুলিকে স্থানান্তরিত করে

Newtons Gesetze in der Gesellschaft: Wie soziale Kräfte physische Körper bewegen

Las leyes de Newton en la sociedad: cómo las fuerzas sociales mueven los cuerpos físicos

Les lois de Newton dans la société : comment les forces sociales déplacent les corps physiques

समाज में न्यूटन के नियम: सामाजिक शक्तियां भौतिक निकायों को कैसे स्थानांतरित करती हैं

社会におけるニュートンの法則: 社会力がどのように物体を動かすか

뉴턴의 사회 법칙: 사회적 힘이 육체를 움직이는 방법

As Leis de Newton na Sociedade: Como as Forças Sociais Movem os Corpos Físicos

Законы Ньютона в обществе: как социальные силы движут физическими телами

Newton'un Toplumdaki Yasaları: Sosyal Güçler Fiziksel Bedenleri Nasıl Hareket Eder?

Định luật Newton trong xã hội: Các lực lượng xã hội di chuyển cơ thể vật chất như thế nào

社会中的牛顿定律：社会力量如何移动身体

Do you know why most information is given away for free? Because it’s meaningless. You optimize your workload, but you (most likely) won’t. You start following a diet and workout routine you saw on IG, but you (probably) won’t. You wake up a changed person tomorrow, but you won’t. could could could The online world is overflowing with info on how to do pretty much anything short of surgery, but people are still fat, business-less (I’m inventing words now), and unhappy. So, why is it so hard to change? Who Is You? If we were to picture what we call on a diagram, it’d look something like this 👇 me Me (Self-concept - the story you tell yourself about who you are) State (Familiar emotional patterns/states which ingrain themselves in our brains in the form of neural pathways) Action (Automatic behaviors, habits - things we do regularly without much thought) These are in a constant feedback loop, forming a continuous cycle. For instance, seeing yourself as a runner influences your daily activities, impacts your feelings, and strengthens your identity as a runner. Likewise, experiencing depression affects your behavior, leading to decreased activity and contributing to a negative self-perception. Even simple actions, like listening to music, can change your emotional state, making you feel more motivated, such as when music energizes you at the gym. There’s something in the middle of this, keeping it all together. It’s called the Black Hole. The Black Hole is an unconscious phenomenon, representing our brain's tendency to favor familiar patterns and resist change. Kind of like neural inertia—our brains optimize for energy efficiency, which often manifests as a resistance to altering established behaviors and thought patterns. So, whenever you attempt to change, this Black Hole pulls you back to familiar ways of being. Even on a biological level, the cost of change is too high. Your usual thoughts, feelings, and actions, held together by the Black Hole, make up the comfort zone. It's a space of habitual patterns where we feel at ease because it's what we’re familiar with, even if we don’t like it. When we engage in self-development, be it therapy, reading a book, coaching, meditation - anything new that activates the brain’s capacity for neuroplasticity, we temporarily step outside our comfort zone. It’s exhilarating at first—motivation surges and we feel primed for change. There’s a sense of progress. However, the outside of the comfort zone is still under the influence of the Black Hole (whose sole job is to keep the status quo), so it draws us back into old patterns. Essentially, the established neural pathways are more robust than your desire to change. That’s when we experience a loss of motivation. That’s why Any immediate change coaches promise is BS - run away as fast as you can. Motivational speakers and YouTube videos don’t work. Reading books doesn’t work either. Consistent small action > consistent information gathering is the only thing that works. How to Change? Real transformation lies beyond the familiar and in a place where we've completely disentangled from the pull of our old self. Achieving this breakthrough requires more than just stepping out—it requires DISCIPLINE. Namely, being disciplined over a period of time to gather enough momentum to escape the Black Hole. long Breakthrough or real change lives outside of the outside of your comfort zone Discipline and commitment equals freedom. Long-term mindset over short-term hopes. Pick a lane and stay on it. ← this is the most underappreciated Discipline and commitment are what carry you through when motivation dissipates. Select one aspect of your life you’d like to change and a strategy (CBT, for example) for improving it, then commit to this approach consistently for six months. single at least Avoid jumping from one method to another, chasing new mentors, or that next life-changing book you saw on Instagram. For real, lasting change, give it six months. The common 90-day advice doesn’t cut it, in my opinion. It leaves us too close to the edge of our comfort zone, not far enough from the Black Hole to lose its grip on us. at least You can begin by picking element within the loop to work on, since these elements—how you view yourself, your emotional state, and your actions—are interconnected, altering one aspect will lead to changes in the others. one TL;DR Gathering information is an ineffective strategy for change, action is. The way to change is to garner enough velocity to break through the outside of your comfort zone to escape the pull of the Black Hole. Avoid quick fixes. Choose one life area, one improvement method, and focus on one part of the feedback loop. Commit for at least six months. The above applies to any area of your life, not just self-development. Photo by on Tegan Mierle Unsplash Also published here

Motivation Doesn't Last: Here's Why

অনুপ্রেরণা স্থায়ী হয় না: এখানে কেন

Motivation ist nicht von Dauer: Hier ist der Grund

La motivación no dura: este es el motivo

La motivation ne dure pas : voici pourquoi

प्रेरणा टिकती नहीं: इसका कारण यहाँ बताया गया है

モチベーションが続かない: その理由は次のとおりです

동기 부여는 지속되지 않습니다. 이유는 다음과 같습니다.

A motivação não dura: aqui está o porquê

Мотивация недолговечна: вот почему

Motivasyon Uzun Sürmüyor: İşte Nedeni

Động lực không kéo dài: Đây là lý do tại sao

动力不会持久：原因如下

In nearly all of my recent explorations of Generative AI, I've come to realize how important prompts are. That hasn't necessarily translated me into writing better prompts all the time, but being aware of the problem is at least one step towards correcting it, right? One of the things that I thought would help me personally would be to have a tool to quickly compare and contrast different prompts. Obviously, I could just open up multiple tabs in a browser, but I really wanted something more direct and simplified for my purposes. With that in mind, let me share what I've built. Prompt Tester Prompt Tester is my incredibly imaginatively named tool to... um... test prompts. It begins with one prompt: The idea is that you enter your initial prompt, and then click one or more times to add more prompts. When ready, you can then just click "Generate Results": Before showing some example results, let me talk a bit about how it was built. The Code The backend is an simple Node.js server that handles throwing up the static HTML and responding to the front-end API requests. Once again, I thank Todd Sharp for sharing his initial code with me. Here's the boring simple handling portion: incredibly async function handler(req, res) {
	console.log('Entered handler.', req.method, req.url);

	if(req.method === 'GET' && req.url.indexOf('favicon.ico') === -1) {
		res.writeHead(200, { 'Content-Type':'text/html' });
		res.write(fs.readFileSync('./demo.html'));
		res.end();
	} else if(req.method === 'POST' && req.url === '/api') {

		let body = '';
		req.on('data', chunk => {
			body += chunk.toString();
		});

		req.on('end', async () => {
			body = JSON.parse(body);
			console.log('BODY:\n', JSON.stringify(body, null, '\t'));

			let result = await callGemini(body.prompt);
			res.writeHead(200, { 'Content-Type':'application/json' });
			res.write(JSON.stringify(result));
			res.end();

		});

	}

}

const server = http.createServer(handler);
server.listen(3000);
console.log('Listening on port 3000'); And the part which just passes the prompt off to Google's . In theory, this could be changed to ChatGPT or any other service. callGemini Gemini API const MODEL_NAME = "gemini-pro";
const API_KEY = process.env.GOOGLE_AI_KEY;

const genAI = new GoogleGenerativeAI(API_KEY);
const model = genAI.getGenerativeModel({ model: MODEL_NAME });

async function callGemini(text) {

	const generationConfig = {
		temperature: 0.9,
		topK: 1,
		topP: 1,
		maxOutputTokens: 2048,
	};

	const safetySettings = [
		{ category: HarmCategory.HARM_CATEGORY_HARASSMENT, threshold: HarmBlockThreshold.BLOCK_MEDIUM_AND_ABOVE, },
		{ category: HarmCategory.HARM_CATEGORY_HATE_SPEECH,	threshold: HarmBlockThreshold.BLOCK_MEDIUM_AND_ABOVE, },
		{ category: HarmCategory.HARM_CATEGORY_SEXUALLY_EXPLICIT, threshold: HarmBlockThreshold.BLOCK_MEDIUM_AND_ABOVE, },
		{ category: HarmCategory.HARM_CATEGORY_DANGEROUS_CONTENT, threshold: HarmBlockThreshold.BLOCK_MEDIUM_AND_ABOVE, },
	];

	const parts = [
    	{text},
  	];

	const result = await model.generateContent({
		contents: [{ role: "user", parts }],
		generationConfig,
		safetySettings,
	});

	try {

		if(result.response.promptFeedback && result.response.promptFeedback.blockReason) {

			return { error: `Blocked for ${result.response.promptFeedback.blockReason}` };
		}
		const response = result.response.candidates[0].content.parts[0].text;
		return { response };
	} catch(e) {
		// better handling
		return {
			error:e.message
		}
	}
	
} I'm proud to say that I'm now, finally, doing some basic error handling and trying to expose to the user (me) why a prompt was blocked. The front end is relatively simple. I used for the core CSS (again, thank you Todd) and some vanilla JavaScript to handle adding new prompts and making the calls. Here's the HTML (minus the inline CSS): Milligram <h1>Prompt Tester</h1>

<p>
This tool helps you see the result of multiple prompts at the same time. The idea is to use similar prompts with different phrasing 
to see how it impacts the result.
</p>

<div id="prompts">
</div>

<template id="promptRow">
<div class="row">
	<div class="column column-33"><textarea placeholder="Enter your prompt."></textarea></div>
	<div class="column column-67 result"></div>
</div>
<hr>
</template>


<div class="float-right">
<button id="addPrompt">Add Prompt</button> <button id="generateResults">Generate Results</button>
</div> And then the JavaScript. Notice I used above to handle the prompt layout. This is the first time I've used that tag, and it was relatively easy. <template> let $template, $prompts, $addPromptsBtn, $generateResultsBtn;
let promptCount = 0;

document.addEventListener('DOMContentLoaded', init, false);
async function init() {
	
	$addPromptsBtn = document.querySelector('#addPrompt');
	$addPromptsBtn.addEventListener('click',  addPrompt, false);
	$generateResultsBtn = document.querySelector('#generateResults')
	$generateResultsBtn.addEventListener('click',  generateResults, false);
	$template = document.querySelector('#promptRow');
	$prompts = document.querySelector('#prompts');

	addPrompt();
}

function addPrompt() {
	promptCount++;
	const newPrompt = $template.content.cloneNode(true);
	$prompts.append(newPrompt);
}

async function generateResults() {
	// disable add prompt and generate
	$addPromptsBtn.setAttribute('disabled', 'disabled');
	$generateResultsBtn.setAttribute('disabled', 'disabled');

	let $results = document.querySelectorAll('div.result');
	// clear any previous results
	$results.forEach(r => r.innerHTML = '');

	/*
	gather prompts from the inputs
	*/
	let prompts = [];
	let $fields = document.querySelectorAll('#prompts textarea');
	for(f of $fields) prompts.push(f.value);

	let promises = [];
	for(p of prompts) promises.push(getResult(p));
	let results = await Promise.all(promises);

	// assign results to result area for each, handle errors - later
	// there's a one to one correspondance between our array of results and the result div
	for(let i=0;i<results.length;i++) {
		if(results[i].response) $results[i].innerHTML = marked.parse(results[i].response);
		else if(results[i].error) $results[i].innerHTML = `<strong>Error with Prompt: </strong> ${results[i].error}`;
	}

	$addPromptsBtn.removeAttribute('disabled');
	$generateResultsBtn.removeAttribute('disabled');

}

async function getResult(p) {
	console.log('get result for',p);
	// quick return on empty prompt
	if(p.trim() === '') return { response:'<strong>Enter a prompt.</strong>' };
	let req = await fetch('/api', { method:'POST', body: JSON.stringify({prompt:p.trim()})});
	let result = await req.json();
	return result;
} I that's all pretty simple DOM manipulation and API calling, but definitely let me know in a comment below if something doesn't make sense. Notice I fire off all my API calls at once and wait for them to finish. think Promise.all Also, note I use the library. The results from Google typically have Markdown, and this helps render them nicely in my little web app. marked All of this isn't terribly interesting I think, but let's look at some testing. As I said, I the style of prompt was important. Having it presented directly to me in a tool went a of a long way to reinforcing that. knew heck Sample Result - Gravity Let's start with a simple idea - explaining gravity but for different age groups. Because of the large size of the results, I'm going to use a bit of CSS here to help keep things sane. Prompt: explain gravity to me but make it appropriate for a child in 1st grade Gravity is a superpower that our planet has! It's like an invisible force that makes everything on Earth stay on the ground. Imagine you have a ball in your hand. When you drop it, what happens? It falls down, right? That's because of gravity. Gravity pulls the ball towards the center of the Earth, and so it falls to the ground. Gravity is also what keeps us on the ground. It's what keeps our feet planted firmly on the Earth and prevents us from floating away! Gravity is a very important force. It keeps everything in place and helps things work the way they do. Without gravity, we would all be floating around in space, and things would be very chaotic! Here's a fun way to think about gravity: imagine that the Earth is a giant magnet, and everything on Earth is made of metal. The magnet pulls the metal objects towards it, and that's what keeps them on the ground. Gravity is a very important and interesting force. It's one of the things that makes our planet such a unique and special place to live! Prompt: explain gravity to me but make it appropriate for a child in 7th grade Imagine you're playing with a ball. You toss it up in the air, and it comes back down to you. This is because of gravity. Gravity is a force that pulls things toward each other. It's what keeps you on the ground and what makes things fall down. The amount of gravity between two objects depends on their mass. The more mass an object has, the stronger its gravity is. That's why things like planets and stars have more gravity than things like people and cars. Gravity is also what keeps the planets in orbit around the sun. The sun's gravity is much stronger than the Earth's, so it pulls the Earth towards it. This keeps the Earth moving in a circle around the sun. Gravity is a very important force in our universe. It keeps things in place and makes things move. Without gravity, the planets would fly off into space, and we would all float away. Here are some fun facts about gravity: Gravity is responsible for the tides. The moon's gravity pulls on Earth's oceans, causing them to rise and fall. Gravity is the reason why we have an atmosphere. Without gravity, the air would just float away into space. Gravity is what makes it possible for us to walk. When we walk, our feet push against the ground, and the ground pushes back. This is what propels us forward. Gravity is the reason why we don't float away into space. Earth's gravity pulls us towards its center, keeping us on the ground. Note the typo in the prompt below. Gemini handled it just fine. Prompt: explain gravity to me but make it appropriate for a college-aged student Gravity: The Force of Attraction Gravity is a fundamental force in the universe responsible for keeping celestial bodies, such as planets, moons, and stars, in motion. It is also what keeps us firmly planted to the ground and allows objects to fall when dropped. Newton's Law of Universal Gravitation: The law of universal gravitation states that every object in the universe attracts every other object with a force proportional to the product of their masses and inversely proportional to the square of the distance between them. Mathematically, it can be expressed as: F = Gm1m2/r^2 Where: F is the gravitational force between two objects. G is the gravitational constant (6.674 × 10^-11 N m^2/kg^2). m1 and m2 are the masses of the two objects. r is the distance between the centers of the two objects. Significance of Gravity: The gravitational pull of larger celestial bodies keeps smaller ones revolving around them. For example, Earth's gravity keeps the moon in orbit, while Sun's gravity keeps Earth and other planets in their respective orbits. Keeps Celestial Bodies in Orbit: Gravity between the Earth and the moon causes ocean tides. As the moon orbits Earth, its gravitational pull creates a bulge in the ocean's water on the side facing the moon. Another bulge forms on the opposite side of Earth due to the inertial forces. As the Earth rotates, these bulges move across the planet's surface, resulting in high and low tides. Responsible for Tides: Gravity pulls objects towards Earth's center, preventing them from floating away. This phenomenon allows us to walk, stand, and interact with our environment. Keeps Objects on Earth: Gravity plays a crucial role in the formation of stars and galaxies. The gravitational collapse of massive clouds of gas and dust leads to the creation of new stars. Similarly, the gravitational pull of galaxies keeps them bound together, preventing them from dispersing. Formation of Stars and Galaxies: Albert Einstein's general relativity theory provides a more comprehensive understanding of gravity. It explains that gravity is not a force but rather a curvature of spacetime caused by the presence of mass or energy. This curvature affects the motion of objects, causing them to follow curved paths rather than straight lines. Relativity Theory: In conclusion, gravity is a fundamental force responsible for keeping celestial bodies in motion, tides, and the behavior of objects on Earth. It is a complex phenomenon that has been studied extensively over the centuries, and it continues to fascinate scientists and researchers to this day. Sample Result - Pets For my second test, I started with a basic prompt and then a better version that asked for specific types of details: (Quick editorial note - the tabular data below is a bit messy, but was messy in the original output.) not Prompt: why are cats so much better than dogs? Cats and dogs are both popular pets, and there is no definitive answer to the question of which one is better. Both cats and dogs have their own unique set of advantages and disadvantages, and the best pet for you will depend on your individual needs and preferences. Some people prefer cats because they are generally more independent than dogs. Cats are typically happy to entertain themselves, and they don't need to be walked or taken outside for exercise. This can be a big advantage for people who live in apartments or who have busy schedules. Cats are also known for being clean and tidy animals. They groom themselves regularly, and they typically use the litter box without any problems. This can be a big advantage for people who don't want to deal with the mess and smell of a dog. Of course, there are also some disadvantages to having a cat. Cats can be more expensive than dogs, and they can be more difficult to train. Cats are also more likely to scratch furniture and other household items. Ultimately, the decision of whether to get a cat or a dog is a personal one. There is no right or wrong answer, and the best pet for you will depend on your individual needs and preferences. Here is a table summarizing the key differences between cats and dogs: Characteristic Cat Dog Independence More independent Less independent Exercise needs Does not need to be walked or taken outside Needs to be walked or taken outside Cleanliness Cleans itself regularly Needs to be bathed regularly Training Can be difficult to train Easier to train Scratching May scratch furniture and other household items Does not typically scratch furniture Cost More expensive Less expensive Prompt: why are cats so much better than dogs? explain with a bulleted list of reasons that cover emotional well being and financial aspects Emotional well-being: Independence: Cats are more independent than dogs, which can be a good thing for people who want a pet that doesn't require a lot of attention. Low maintenance: Cats are generally lower maintenance than dogs. They don't need to be walked or groomed as often, and they can be left alone for longer periods of time. Quiet: Cats are generally quieter than dogs, which can be ideal for people who live in apartments or have noise-sensitive neighbors. Therapeutic: Studies have shown that cats can have a calming effect on humans, and they can help to reduce stress and anxiety. Financial aspects: Lower cost: Cats are generally less expensive to own than dogs. They eat less food, they need fewer vet visits, and they don't require as much grooming. Easier to travel with: Cats are easier to travel with than dogs. They can be transported in a carrier, and they don't need to be walked or exercised while you're away. Longer lifespan: Cats have a longer lifespan than dogs, on average. This means that you can enjoy your cat's companionship for many years to come. Sample Result - Chain of Thought Prompting The following test came from an presentation from AWS re:Invent: . I found a lot of great advice from this session, including a good overview of Chain of Thought prompting, where the idea is you provide information about the steps used to solve a problem to help the GenAI engine better solve a prompt. excellent AWS re:Invent 2023 - Prompt engineering best practices for LLMs on Amazon Bedrock (AIM377) Now, the example given in that presentation went like so: Q: Roger has 5 tennis balls. he buys 2 more cans of tennis balls. Each 
can has 3 tennis balls. How many tennis balls does he have now?

A: The answer is 11.

Q. The cafeteria had 23 apples. If they used 20 to make lunch and 
bought 6 more, how many apples do they have? In the presentation, the model in use incorrectly returned 27. In my test, it worked correctly, but I absolutely saw issues with math back when I built my last November. generative AI blackjack advice demo As I said, Gemini handled it fine: But in Prompt Tester, I tried the suggested CoT prompt: A: The answer is 9. Q: Roger has 5 tennis balls. he buys 2 more cans of tennis balls. Each 
can has 3 tennis balls. How many tennis balls does he have now?

A: Roger started with 5 balls. 2 cans of 3 tennis balls each is 6 
tennis balls. 5 + 6 = 11. The answer is 11.

Q. The cafeteria had 23 apples. If they used 20 to make lunch and 
bought 6 more, how many apples do they have? And the result was improved, showing how it got to the answer: A: The cafeteria had 23 apples. They used 20 apples for lunch, which 
means they have 3 apples left. They then bought 6 more apples, so 
they now have a total of 3 + 6 = 9 apples.

The answer is 9. The difference is pretty significant. The Code If this seems useful to you at all, feel free to grab the code from here: . As I mentioned, it shouldn't be that difficult to add or some such and use a different service. If you do, let me know! https://github.com/cfjedimaster/ai-testingzone/tree/main/prompt_tester callChatGPT

How to Test Multiple Variations of Generative AI Prompts

জেনারেটিভ এআই প্রম্পটগুলির একাধিক বৈচিত্র কীভাবে পরীক্ষা করবেন

So testen Sie mehrere Variationen generativer KI-Eingabeaufforderungen

Cómo probar múltiples variaciones de indicaciones de IA generativa

Comment tester plusieurs variantes d'invites d'IA générative

जेनरेटिव एआई प्रॉम्प्ट के एकाधिक विविधताओं का परीक्षण कैसे करें

生成 AI プロンプトの複数のバリエーションをテストする方法

Generative AI 프롬프트의 다양한 변형을 테스트하는 방법

Como testar múltiplas variações de prompts de IA generativos

Как протестировать несколько вариантов подсказок генеративного ИИ

Üretken Yapay Zeka İstemlerinin Çoklu Varyasyonlarını Test Etme

Cách kiểm tra nhiều biến thể của lời nhắc AI sáng tạo

如何测试生成式 AI 提示的多种变体

Retrieval augmented generation (RAG) is by now of generative artificial intelligence (AI) applications. Supplementing your application prompt with relevant context retrieved from a vector database can dramatically increase accuracy and reduce hallucinations. This means that increasing relevance in vector search results has a direct correlation to the quality of your RAG application. a standard part There are two reasons RAG remains popular and increasingly relevant even : as large language models (LLMs) increase their context window LLM response time and price both increase linearly with context length. LLMs still struggle with both and across massive contexts. retrieval reasoning But isn’t a magic wand. In particular, the most common design, dense passage retrieval (DPR), represents both queries and passages as a single embedding vector and uses straightforward to score relevance. This means DPR relies heavily on the embeddings model having the breadth of training to recognize all the relevant search terms. RAG cosine similarity Unfortunately, off-the-shelf models struggle with unusual terms, including names, that are not commonly in their training data. DPR also tends to be hypersensitive to chunking strategy, which can cause a relevant passage to be missed if it’s surrounded by a lot of irrelevant information. All of this creates a burden on the application developer to “get it right the first time,” because a mistake usually results in the need to rebuild the index from scratch. Solving DPR’s challenges with ColBERT is a new way of scoring passage relevance using a language model that substantially solves the problems with DPR. This diagram from shows why it’s so exciting: ColBERT BERT the first ColBERT paper This compares the performance of ColBERT with other state-of-the-art solutions for the MS-MARCO dataset. (MS-MARCO is a set of Bing queries for which scored the most relevant passages by hand. It’s one of the better retrieval benchmarks.) Lower and to the right is better. Microsoft In short, ColBERT handily outperforms the field of mostly significantly more complex solutions at the cost of a small increase in latency. To test this, I created and indexed over 1,000 Wikipedia articles with both ada002 DPR and ColBERT. I found that ColBERT delivers significantly better results on unusual search terms. a demo The following screenshot shows that DPR fails to recognize the unusual name of William H. Herndon, an associate of Abraham Lincoln, while ColBERT finds the reference in the Springfield article. Also note that ColBERT’s No. 2 result is for a different William, while none of DPR’s results are relevant. ColBERT is often described in dense machine learning jargon, but it’s actually very straightforward. I’ll show how to implement ColBERT retrieval and scoring on with only a few lines of Python and (CQL). DataStax Astra DB Cassandra Query Language The big idea Instead of traditional, single-vector-based DPR that turns passages into a single “embedding” vector, ColBERT generates a contextually influenced for each token in the passages. ColBERT similarly generates vectors for each token in the query. vector (Tokenization refers to breaking up input into fractions of words before processing by an LLM. .) Andrej Karpathy, a founding member of the OpenAI team, just released an outstanding video on how this works Then, the score of each document is the sum of the maximum similarity of each query embedding to any of the document embeddings: def maxsim(qv, document_embeddings):
    return max(qv @ dv for dv in document_embeddings)

def score(query_embeddings, document_embeddings):
    return sum(maxsim(qv, document_embeddings) for qv in query_embeddings) (@ is the PyTorch operator for dot product and is the most common .) measure of vector similarity That’s it — you can implement ColBERT scoring in four lines of Python! Now you understand ColBERT better than 99% of the people posting about it on X (formerly known as Twitter). The rest of the ColBERT papers deal with: How do you fine-tune the BERT model to generate the best embeddings for a given data set? How do you limit the set of documents for which you compute the (relatively expensive) score shown here? The first question is optional and out of scope for this writeup. I’ll use the pretrained ColBERT checkpoint. But the second is straightforward to do with a vector database like DataStax Astra DB. ColBERT on Astra DB There is a popular Python all-in-one library for ColBERT called ; however, it assumes a static dataset. One of the powerful features of RAG applications is responding to dynamically . So instead, I’m going to use Astra’s vector index to narrow the set of documents I need to score down to the best candidates for each subvector. RAGatouille changing data in real time There are two steps when adding ColBERT to a RAG application: ingestion and retrieval. Ingestion Because each document chunk will have multiple embeddings associated with it, I’ll need two tables: CREATE TABLE chunks (
    title text,
    part int,
    body text,
    PRIMARY KEY (title, part)
);

CREATE TABLE colbert_embeddings (
    title text,
    part int,
    embedding_id int,
    bert_embedding vector<float, 128>,
    PRIMARY KEY (title, part, embedding_id)
);

CREATE INDEX colbert_ann ON colbert_embeddings(bert_embedding)
  WITH OPTIONS = { 'similarity_function': 'DOT_PRODUCT' }; After installing the ColBERT library ( ) and downloading , I can load documents into these tables: pip install colbert-ai the pretrained BERT checkpoint from colbert.infra.config import ColBERTConfig
from colbert.modeling.checkpoint import Checkpoint
from colbert.indexing.collection_encoder import CollectionEncoder

from cassandra.concurrent import execute_concurrent_with_args
from db import DB


def encode_and_save(title, passages):
    db = DB()
    cf = ColBERTConfig(checkpoint='checkpoints/colbertv2.0')
    cp = Checkpoint(cf.checkpoint, colbert_config=cf)
    encoder = CollectionEncoder(cf, cp)

    # encode_passages returns a flat list of embeddings and a list of how many correspond to each passage
    embeddings_flat, counts = encoder.encode_passages(passages)

    # split up embeddings_flat into a nested list
    start_indices = [0] + list(itertools.accumulate(counts[:-1]))
    embeddings_by_part = [embeddings_flat[start:start+count] for start, count in zip(start_indices, counts)]

    # insert into the database
    for part, embeddings in enumerate(embeddings_by_part):
        execute_concurrent_with_args(db.session,
                                     db.insert_colbert_stmt,
                                     [(title, part, i, e) for i, e in enumerate(embeddings)]) (I like to encapsulate my DB logic in a dedicated module; you can access the full source in my .) GitHub repository Retrieval Then retrieval looks like this: def retrieve_colbert(query):
    db = DB()
    cf = ColBERTConfig(checkpoint='checkpoints/colbertv2.0')
    cp = Checkpoint(cf.checkpoint, colbert_config=cf)
    encode = lambda q: cp.queryFromText([q])[0]

    query_encodings = encode(query)
    # find the most relevant documents for each query embedding. using a set
    # handles duplicates so we don't retrieve the same one more than once
    docparts = set()
    for qv in query_encodings:
        rows = db.session.execute(db.query_colbert_ann_stmt, [list(qv)])
        docparts.update((row.title, row.part) for row in rows)
    # retrieve these relevant documents and score each one
    scores = {}
    for title, part in docparts:
        rows = db.session.execute(db.query_colbert_parts_stmt, [title, part])
        embeddings_for_part = [tensor(row.bert_embedding) for row in rows]
        scores[(title, part)] = score(query_encodings, embeddings_for_part)
    # return the source chunk for the top 5
    return sorted(scores, key=scores.get, reverse=True)[:5] Here is the query being executed for the most-relevant-documents part ( ): db.query_colbert_ann_stmt SELECT title, part
FROM colbert_embeddings
ORDER BY bert_embedding ANN OF ?
LIMIT 5 Beyond the basics: RAGStack This article and the linked repository briefly introduce how ColBERT works. You can implement this today with your own data and see immediate results. As with everything in AI, best practices are changing daily, and new techniques are constantly emerging. To make keeping up with the state of the art easier, DataStax is rolling this and other enhancements into , our production-ready RAG library leveraging LangChain and LlamaIndex. Our goal is to provide developers with a consistent library for RAG applications that puts them in control of the step-up to new functionality. Instead of having to keep up with the myriad changes in techniques and libraries, you have a single stream, so you can focus on building your application. You can use RAGStack today to incorporate best practices for LangChain and LlamaIndex out of the box; advances like ColBERT will come to RAGstack in upcoming releases. RAGStack By Jonathan Ellis, DataStax Also appears . here

How ColBERT Helps Developers Overcome the Limits of RAG

কিভাবে ColBERT ডেভেলপারদের RAG এর সীমা অতিক্রম করতে সাহায্য করে

Wie ColBERT Entwicklern hilft, die Grenzen von RAG zu überwinden

Cómo ColBERT ayuda a los desarrolladores a superar los límites de RAG

Comment ColBERT aide les développeurs à surmonter les limites de RAG

कैसे ColBERT डेवलपर्स को RAG की सीमाओं को पार करने में मदद करता है

ColBERT が開発者による RAG の限界の克服にどのように役立つか

ColBERT가 개발자가 RAG의 한계를 극복하도록 돕는 방법

Como ColBERT ajuda os desenvolvedores a superar os limites do RAG

Как ColBERT помогает разработчикам преодолеть ограничения RAG

ColBERT, Geliştiricilerin RAG Sınırlarını Aşmasına Nasıl Yardımcı Olur?

ColBERT giúp nhà phát triển vượt qua giới hạn của RAG như thế nào

ColBERT 如何帮助开发人员克服 RAG 的限制

ILERT

ilert.com

-- employees

Since n.d.

COMPANY RANKING

ILERT

EVERGREEN INDEX #5784

Representing this company? Click here to claim and customize this page!

iLert WIKI

Apply to get your Tech Company News Page live on HackerNoon.com today!

ILERT

ilert.com

-- employees

Since n.d.

COMPANY RANKING

ILERT

EVERGREEN INDEX #5784

RELATED COMPANIESRANK

STORIES ABOUT ILERT

Representing this company? Click here to claim and customize this page!

iLert WIKI

Apply to get your Tech Company News Page live on HackerNoon.com today!