Imilayezo Ethembekile Kuzinhlelo Ezisabalalisiwe

Inkinga yokubhala kabili

Ukwakha uhlelo oluthembekile, olutholakala kakhulu, olusabalaliswa kalula ludinga ukubambelela kumasu athile, izimiso, namaphethini. Ukwakhiwa kwezinhlelo ezinjalo kubandakanya ukubhekana nenqwaba yezinselelo. Phakathi kwezindaba ezivame kakhulu neziyisisekelo inkinga yokubhala okukabili .

"Inkinga yokubhala okukabili" inselele evela ezinhlelweni ezisabalalisiwe, ikakhulukazi lapho kukhulunywa ngemithombo yedatha eminingi noma izizindalwazi ezidinga ukugcinwa ekuvunyelanisweni. Kubhekisela ebunzimeni bokuqinisekisa ukuthi izinguquko zedatha zibhalwa ngokungaguquki ezitolo zedatha ezihlukahlukene, njengezigcinilwazi noma izinqolobane, ngaphandle kokwethula izinkinga ezifana nokungahambisani kwedatha, ukungqubuzana, noma izithiyo zokusebenza.

I-microservices architecture kanye nesizindalwazi sephethini ngesevisi ngayinye ikulethela izinzuzo eziningi, njengokuthunyelwa okuzimele nokukala, ukwehluleka okukodwa, kanye nokukhushulwa okungenzeka kwesivinini sokuthuthukiswa. Kodwa-ke, ukusebenza kudinga izinguquko phakathi kwama-microservices amaningi, okukuphoqa ukuthi ucabange ngesixazululo esithembekile sokubhekana nale nkinga.

Cishe isibonelo sangempela

Ake sicabangele isimo lapho isizinda sethu sibandakanya ukwamukela izicelo zemalimboleko, sizihlole, bese sithumela izaziso zesaziso kumakhasimende.

Ngokomoya wesimiso esinomthwalo wemfanelo owodwa, umthetho ka-Conway, kanye nendlela yokuklama eqhutshwa isizinda, ngemva kwezikhathi ezimbalwa zokuhlasela izenzakalo, sonke isizinda sahlukaniswa saba izizindana ezingaphansi ezintathu ezinomongo onqunyelwe ochaziwe onemingcele ecacile, amamodeli wesizinda, nolimi olutholakala yonke indawo.

Esokuqala sinikezwe umsebenzi wokugibela kanye nokuhlanganisa izicelo ezintsha zokubolekwa imali. Uhlelo lwesibili luhlola lezi zinhlelo zokusebenza bese lwenza izinqumo ngokusekelwe kudatha enikeziwe. Le nqubo yokuhlola, ehlanganisa i-KYC/KYB, ukuvimbela ukukhwabanisa, nokuhlolwa kwengozi yesikweletu, kungase kudle isikhathi, okudinge ikhono lokusingatha izinkulungwane zezicelo ngesikhathi esisodwa. Ngenxa yalokho, lokhu kusebenza kudluliselwe ku-microservice ezinikele enesizindalwazi sayo, okuvumela ukukala okuzimele.

Ngaphezu kwalokho, lawa masistimu angaphansi aphethwe amaqembu amabili ahlukene, ngalinye linemijikelezo yalo yokukhishwa, izivumelwano zeleveli yesevisi (i-SLA), kanye nezidingo zokukala.

Okokugcina , isevisi yesaziso esikhethekile isikhona ukuthumela izaziso kumakhasimende.

Nansi incazelo ethuthukisiwe yesimo esiyinhloko sokusetshenziswa kwesistimu:

1. Ikhasimende lithumela isicelo semalimboleko.
2. Isevisi Yesicelo Semali Ebolekiwe irekhoda isicelo esisha ngesimo esithi "Kusalindile" futhi iqala inqubo yokuhlola ngokudlulisela isicelo Kusevisi Yokuhlola.
3. Isevisi Yokuhlola ihlola isicelo semalimboleko engenayo bese yazisa Isevisi Yesicelo Semalimboleko ngesinqumo.
4. Lapho ithola isinqumo, Isevisi Yesicelo Semalimboleko ibuyekeza isimo sesicelo semalimboleko ngokufanele futhi icuphe Isevisi Yezaziso ukuthi yazise ikhasimende ngomphumela.
5. Isevisi Yezaziso icubungula lesi sicelo futhi ithumele izaziso ekhasimendeni nge-imeyili, i-SMS, noma ezinye izindlela zokuxhumana ezikhethwayo, ngokuya ngezilungiselelo zekhasimende.

Iwuhlelo olulula kakhulu futhi lwakudala uma uthi nhlá, kodwa ake singene siqonde ukuthi isevisi yesicelo seMalimboleko iwucubungula kanjani umyalo wokufaka isicelo semalimboleko.

Singacabangela izindlela ezimbili zokusebenzisana kwesevisi:

1. I-First-Local-Commit-Then-Publish: Ngale ndlela, isevisi ibuyekeza isizindalwazi sayo sendawo (iyazibophezela) bese ishicilela umcimbi noma umlayezo kwezinye izinkonzo.

2. I-First-Publish-Then-Local-Commit: Ngokuphambene, le ndlela ihlanganisa ukushicilela umcimbi noma umlayezo ngaphambi kokwenza izinguquko kusizindalwazi sendawo.

   
   

Zombili izindlela zinezihibe zazo futhi aziphephile kancane ekuxhumaneni ezinhlelweni ezisabalalisiwe.

Lona umdwebo wokulandelana wokusebenzisa indlela yokuqala.

Kulesi simo, Isevisi Yesicelo Semali Ebolekiwe isebenzisa indlela YokuQala-Kwasendaweni-Izibophezele-Bese-Ishicilele , lapho iqala khona ukwenza umsebenzi bese izama ukuthumela isaziso kwenye isistimu. Kodwa-ke, le nqubo ingase yehluleke uma, ngokwesibonelo, kunezinkinga zenethiwekhi, Isevisi Yokuhlola ingatholakali, noma Isevisi Yesicelo Semalimboleko ihlangabezana nephutha lokuphuma kweMemori (OOM) nokuphahlazeka. Ezimweni ezinjalo, umlayezo uzolahleka, kushiye Ukuhlola ngaphandle kwesaziso sesicelo esisha semalimboleko, ngaphandle kwalapho kuqaliswa izinyathelo ezengeziwe.

Neyesibili.

Esimweni Sokushicilelwa Kokuqala Kwase-ke-sendawo , Isevisi Yesicelo Semalimboleko ibhekene nezingozi ezinkulu kakhulu. Ingase yazise Isevisi Yokuhlola mayelana nohlelo lokusebenza olusha kodwa yehluleke ukulondoloza lesi sibuyekezo endaweni ngenxa yezinkinga ezifana nezinkinga zesizindalwazi, amaphutha enkumbulo, noma iziphazamisi zekhodi. Le ndlela ingaholela ekushintshaneni okuphawulekayo kwedatha, okungase kubangele izinkinga ezinkulu, kuye ngokuthi Isevisi Yokubuyekeza Imalimboleko iziphatha kanjani izinhlelo zokusebenza ezingenayo.

Ngakho-ke, kufanele sihlonze isisombululo esinikeza indlela eqinile yokushicilela imicimbi kubathengi bangaphandle. Kodwa, ngaphambi kokungena ezisombululweni ezingaba khona, kufanele siqale sicacise izinhlobo zeziqinisekiso zokulethwa kwemiyalezo ezingafinyeleleka kumasistimu asabalalisiwe.

Iziqinisekiso zokulethwa komlayezo

Kunezinhlobo ezine zeziqinisekiso esingazithola.

1. Azikho iziqinisekiso
   Asikho isiqinisekiso sokuthi umlayezo uzolethwa endaweni oya kuyo. Indlela ethi First-Local-Commit-Then-Publish imayelana nalokhu. Abathengi bangase bathole imilayezo kanye, izikhathi eziningi, noma bangalokothi bathole nhlobo.

2. Ukulethwa kanye nje
   Ukulethwa kanye nje kusho ukuthi umlayezo uzolethwa endaweni okungenani isikhathi esingu-1. Indlela ethi First-Local-Commit-Then-Publish ingasetshenziswa ngale ndlela kanye nenqubomgomo yokuzama kabusha yemizamo enevelu yokuqala.

3. Okungenani kanye uma kulethwa\Abathengi bazothola futhi bacubungule yonke imilayezo kodwa bangathola umlayezo ofanayo izikhathi ezingaphezu kwesisodwa.

4. Ukulethwa kanye kanye\Kanye kanye ukulethwa kusho ukuthi umthengi uzothola umlayezo ngempumelelo kanye.
   Ngobuchwepheshe, kuyenzeka ukuthi kuzuzwe nge-Kafka transactions kanye nokusetshenziswa okuqondile komkhiqizi nomthengi.

   
   

Ezimweni eziningi, iziqinisekiso zokulethwa 'okungenani kanye' zibhekana nezinkinga eziningi ngokuqinisekisa ukuthi imilayezo ilethwa okungenani kanye, kodwa abathengi kufanele bangabi namandla. Kodwa-ke, uma kubhekwa ukwehluleka kwenethiwekhi okungagwemeki, yonke ingqondo yomthengi kufanele ingabi namandla ukugwema ukucubungula imilayezo eyimpinda, kungakhathaliseki iziqinisekiso zomkhiqizi. Ngakho-ke, le mfuneko ayikona ukuhlehla kangako njengoba ibonisa iqiniso.

Izixazululo

Kunenqwaba yezixazululo zale nkinga, ezinezinzuzo kanye nokubi.

Ukuzibophezela kwezigaba ezimbili

Ngokuvumelana ne Wikipedia, i-Two-Phase Commit (2PC) iyiphrothokholi yokuthengiselana esabalalisiwe esetshenziswa kusayensi yekhompiyutha kanye nezinhlelo zokuphatha isizindalwazi ukuze kuqinisekiswe ukuvumelana nokuthembeka kokuthengiselana okusabalalisiwe. Idizayinelwe izimo lapho izinsiza eziningi (isb., izizindalwazi) zidinga ukubamba iqhaza kumsebenzi owodwa, futhi iqinisekisa ukuthi zonke ziyawenza okwenziwayo noma zonke ziyayichitha, ngaleyo ndlela igcine ukufana kwedatha. Kuzwakala impela esikudingayo, kepha i-Two-Phase Commit inezinkinga ezimbalwa:

• Uma insiza eyodwa ebamba iqhaza ingasabeli noma ihlangabezana nokuhluleka, yonke inqubo ingavinjwa kuze kube yilapho inkinga isixazululiwe. Lokhu kungaholela ekusebenzeni okungenzeka kube nezinkinga nokutholakala.
• I-Two-Phase Commit ayinikezi izindlela ezakhelwe ngaphakathi zokubekezelela amaphutha. Incike ezindleleni zangaphandle noma ukungenelela okwenziwa ngesandla ukuze kusingathwe ukwehluleka.
• Akuwona wonke ama-database esimanje asekela i-Two-Phase Commit.

Isizindalwazi esabiwe

Isixazululo esibonakala kakhulu se-microservices architecture ukusebenzisa iphethini (noma ngezinye izikhathi i-anti-pattern) - isizindalwazi esabiwe. Le ndlela inembile kakhulu uma udinga ukuvumelana kokwenzekayo kuwo wonke amathebula amaningi kuzinqolobane ezihlukene, vele usebenzise isizindalwazi esisodwa esabiwe salezi zinsiza ezincane.

Izithiyo zale ndlela zihlanganisa ukwethulwa kwephuzu elilodwa lokwehluleka, ukuvimbela ukukalwa kwedatha egciniwe okuzimele, kanye nokunciphisa ikhono lokusebenzisa izixazululo zedathabhesi ehlukene ezifaneleka kakhulu izidingo ezithile kanye namacala okusetshenziswa. Ukwengeza, ukuguqulwa kuma-codebases we-microservices kungadingeka ukuze kusekelwe uhlobo olunjalo lomsebenzi osabalalisiwe.

Ibhokisi lokuphumayo lokwenziwayo

' Ibhokisi lokuphumayo lokuthengiselana ' liyiphethini yokuklama esetshenziswa ezinhlelweni ezisabalalisiwe ukuze kuqinisekiswe ukusatshalaliswa komlayezo okuthembekile, ngisho nalapho kubhekene nezinhlelo zemiyalezo ezingathembekile. Kubandakanya ukugcina imicimbi kuthebula elikhethiwe le-'OutboxEvents' phakathi komsebenzi ofanayo nomsebenzi ngokwawo. Le ndlela ihambisana kahle nezakhiwo ze-ACID zolwazi olugciniwe. Ngokuphambene, imininingwane eminingi ye-No-SQL ayisekeli ngokugcwele izakhiwo ze-ACID, esikhundleni salokho ikhetha imigomo ye-CAP theorem nefilosofi ye-BASE, ebeka phambili ukutholakala nokuvumelana ekugcineni kunokuvumelana okuqinile.

Ibhokisi lokuphumayo lokwenziwayo linikeza isiqinisekiso okungenani kanye futhi lingasetshenziswa ngezindlela ezimbalwa:

1. Umsila welogi yokwenziwe

2. Umshicileli wokuvota

   
   

Indlela yokulandelanisa ilogu yokwenziwayo isho ukusebenzisa izixazululo eziqondene nesizindalwazi ezifana ne-CDC (Shintsha Ukuthwebula Kwedatha). Izithiyo eziyinhloko zaleyo ndlela yilezi:

• Izixazululo eziqondene nesizindalwazi

• Ukubambezeleka okukhulisiwe ngenxa yemininingwane ethile yokusetshenziswa kwe-CDC

  
  

Enye indlela I- Polling Publisher , esiza ukulayishwa kwebhokisi lokuphumayo ngokuvotela ithebula lebhokisi lokuphumayo. I-drawback eyinhloko yale ndlela yikhono lokwenyuka komthwalo we-database, okungaholela ezindlekweni eziphezulu. Ngaphezu kwalokho, akuzona zonke izizindalwazi ze-No-SQL ezisekela imibuzo ephumelelayo yezingxenye ezithile zedokhumenti. Ngakho-ke, ukukhipha wonke amadokhumenti kungaholela ekwehleni kokusebenza.

Nawu umdwebo omncane wokulandelana ochaza ukuthi usebenza kanjani.

Zilalele wena

Inselele enkulu ngephethini Yebhokisi Lemilayezo Ephumayo Yokwenziwayo ilele ekuncikeni kwayo kusizindalwazi sezakhiwo ze-ACID. Ingahle iqonde kusizindalwazi esijwayelekile se-OLTP kodwa ilethe izinselelo endaweni ye-NoSQL. Ukuze kubhekwane nalokhu, isixazululo esingaba khona ukusebenzisa ilogi yesithasiselo (ngokwesibonelo, i-Kafka) kusukela ekuqaliseni ukucutshungulwa kwesicelo.

Esikhundleni sokucubungula ngokuqondile umyalo 'wokuhambisa isicelo semalimboleko', siwuthumela ngokushesha esihlokweni sangaphakathi se-Kafka bese sibuyisela umphumela 'owamukelwe' kuklayenti. Nokho, njengoba kungenzeka kakhulu ukuthi umyalo usadinga ukucutshungulwa, asikwazi ukwazisa ikhasimende ngokushesha ngomphumela. Ukuze silawule lokhu kuvumelana ekugcineni, singasebenzisa amasu afana nokuvota okude, ukuvota okuqalwe yiklayenti, ukubuyekezwa kwe-UI okunethemba, noma ukusebenzisa i-WebSockets noma Imicimbi Ethunyelwe Ngeseva ukuze uthole izaziso. Nokho, lesi yisihloko esihluke ngokuphelele, ngakho-ke ake sibuyele esihlokweni sethu sokuqala.

Sithumele umlayezo ngesihloko sangaphakathi se-Kafka. Isevisi Yesicelo Semali Ebolekiwe ibe isisebenzisa lo mlayezo - umyalo ofanayo ewuthole kuklayenti - bese iqala ukucutshungulwa. Okokuqala, yenza umqondo othile webhizinisi; kuphela ngemva kokuba le logic isetshenziswe ngempumelelo futhi imiphumela iphikelela, ishicilela imilayezo emisha esihlokweni sasesidlangalaleni se-Kafka.

Ake sibheke i-pseudo-code.

 public async Task HandleAsync(SubmitLoanApplicationCommand command, ...) { //First, process business logic var loanApplication = await _loanApplicationService.HandleCommandAsync(command, ...); //Then, send new events to public Kafka topic producer.Send(new LoanApplicationSubmittedEvent(loanApplication.Id)); //Then, commit offset consumer.Commit(); }

Kuthiwani uma ukucutshungulwa komqondo webhizinisi kwehluleka? Azikho izinkathazo, njengoba i-offset ingakenziwa, umlayezo uzozanywa futhi.

Kuthiwani uma ukuthumela imicimbi emisha e-Kafka kwehluleka? Azikho izinkathazo, njengoba ingqondo yebhizinisi ingenangqondo, ngeke idale isicelo semalimboleko esiyimpinda. Kunalokho, izozama ukuthumela kabusha imilayezo esihlokweni esisesidlangalaleni se-Kafka.

Kuthiwani uma imilayezo ithunyelwa e-Kafka, kodwa isivumelwano se-offset sihluleka? Azikho izinkathazo, njengoba ingqondo yebhizinisi ingenangqondo, ngeke idale isicelo semalimboleko esiyimpinda. Kunalokho, izothumela imilayezo esihlokweni esisesidlangalaleni se-Kafka futhi sithemba ukuthi ukuzibophezela kwe-offset kuzophumelela kulokhu.

Izithiyo eziyinhloko zale ndlela zihlanganisa inkimbinkimbi eyengeziwe ehlotshaniswa nesitayela esisha sokuhlela, ukungaguquguquki ekugcineni (njengoba iklayenti ngeke liwazi umphumela ngokushesha), kanye nemfuneko yokuthi wonke umqondo webhizinisi ungabi namandla.

Ukuthola umcimbi

Kuyini ukuthola umcimbi, futhi ungasetshenziswa kanjani lapha? Ukuthola umcimbi iphethini yezakhiwo zesofthiwe esetshenziselwa ukumodela isimo sesistimu ngokuthwebula zonke izinguquko kudatha yayo njengochungechunge lwemicimbi engaguquleki. Lezi zenzakalo zimelela amaqiniso noma izinguquko zesimo futhi zisebenza njengomthombo owodwa weqiniso wesimo samanje sesistimu. Ngakho-ke, ngokobuchwepheshe, ngokusebenzisa uhlelo lokuthola umcimbi, sesivele sinayo yonke imicimbi ku-EventStore, futhi le EventStore ingasetshenziswa abathengi njengomthombo owodwa weqiniso mayelana nokwenzekile. Asikho isidingo sesixazululo sesizindalwazi esithile sokulandelela zonke izinguquko noma ukukhathazeka mayelana noku-oda, inkinga kuphela ihlezi ohlangothini lokufunda kusukela ukuze ukwazi ukuthola isimo sangempela sebhizinisi siyadingeka ukuze udlale kabusha yonke imicimbi.

Isiphetho

Kulesi sihloko, sibuyekeze izindlela ezimbalwa zokwakha imiyalezo ethembekile kumasistimu asabalalisiwe. Kunezincomo ezimbalwa esingase sizicabange ngenkathi sakha amasistimu analezi zici

1. Hlala uthuthukisa abathengi abangenamandla njengoba ukwehluleka kwenethiwekhi akunakugwenywa.
2. Sebenzisa ngokucophelela i-First-Local-Commit-Then-Publish ngokuqonda okucacile kwezimfuneko zesiqinisekiso.
3. Ungalokothi usebenzise indlela ye-First-Publish-Then-Local-Commit njengoba ingase iholele ekushintshashintsheni kwedatha kusistimu yakho.
4. Uma isinqumo esikhona sokukhethwa kwesizindalwazi singase sishintshe noma isu lobuchwepheshe lisikisela ukukhetha isixazululo esingcono kakhulu sokulondoloza senkinga — ungakhi imitapo yolwazi ehlanganyelwe ngokubophezela kuzisombululo zesizindalwazi njenge -CDC .
5. Sebenzisa indlela ye -Transactional Outbox njengesixazululo esijwayelekile sokufeza iziqinisekiso okungenani kanye.
6. Cabangela ukusebenzisa indlela ethi Zilalele lapho imininingwane egciniwe ye-No-SQL isetshenziswa.

Ngokuzayo, sizobheka isibonelo esisebenza kakhulu sokuqalisa Ibhokisi Lemilayezo Ephumayo Yokwenziwayo. Bheka

wena!