paint-brush
Open-Source: Nhanho Inotevera muAI Revolutionby@minio
109,673 kuverenga
109,673 kuverenga

Open-Source: Nhanho Inotevera muAI Revolution

by MinIO6m2024/01/25
Read on Terminal Reader
Read this story w/o Javascript

Kurebesa; Kuverenga

Uku kuongorora kweramangwana reyakavhurika-sosi AI ichatsemura "vanyepedzeri" uye kurwira "chaiyo" mukuvandudza kweAI kufumura injini yekuvandudza iyo yakavhurika-sosi software inoyerera pasi pazvo zvese. Chinokosha ndechekuti yakavhurika-sosi AI ichabereka yakavhurika-sosi data stack.

People Mentioned

Mention Thumbnail
featured image - Open-Source: Nhanho Inotevera muAI Revolution
MinIO HackerNoon profile picture
0-item
1-item


Fungidzira ramangwana iro AI isina kukiyirwa kure mudzimba dzemakambani, asi yakavakirwa pachena, zvidhinha nezvidhinha, nenharaunda yepasi rose yevagadziri. Uko kubatana, kwete kukwikwidza, kunopisa kufambira mberi, uye kufunga kwetsika kunobata huremu hwakaenzana nekuita kwakashata. Iyi haisi ngano yesainzi, ndiyo yakavhurika-sosi shanduko iri kubikwa mukati memoyo webudiriro yeAI. Asi Big Tech ine yayo ajenda, masking akaganhurirwa modhi seyakavhurika sosi uchiedza kukohwa mabhenefiti enharaunda yakavhurika zvechokwadi.


Ngatidzorerei kumashure zvidimbu zvekodhi uye tiburitse chokwadi chiri kuseri kwekuedza uku. Uku kuongorora kweramangwana reyakavhurika-sosi AI ichatsemura "vanyepedzeri" uye kurwira "chaiyo" mukuvandudza kweAI kufumura injini yekuvandudza iyo yakavhurika-sosi software inoyerera pasi pazvo zvese. Chinokosha ndechekuti yakavhurika-sosi AI ichabereka yakavhurika-sosi data stack.


Kudiwa

Chinyorwa chazvino chakanyorwa naMatteo Wong muThe Atlantic, ' Pakanga Pakambove Nechinhu Chakadai se 'Vhura' AI ' inotsanangura maitiro ari kukura muacademia uye software nharaunda yechokwadi yakavhurika sosi AI. "Pfungwa iyi ndeyekugadzira mamodheru akajeka ayo veruzhinji vanogona kushandisa zviri nyore uye zvakachipa, kudzidza, uye kuberekazve, kuyedza kuita democratise tekinoroji yakatarisana neiyo inogona kushandura basa, mapurisa, varaidzo uye kunyangwe chitendero." Iyoyo Atlantic inoratidza kuti makambani eBig Tech akaita seMeta ari kuyedza kuzadza ichi chinodiwa mumusika ne 'kuvhura-kugeza' zvigadzirwa zvavo. Ivo vari kutora hunhu uye mukurumbira wakanaka wenzvimbo yakavhurika-sosi pasina kuvhurika-kuvhura chigadzirwa chavo. Asi, hapana chinotsiva chinhu chaicho. Izvi zvinodaro nekuti yechokwadi yakavhurika-sosi software inotyaira hunyanzvi uye kubatana: hunhu huviri hunodiwa zvakanyanya kuti uenderere mberi neAI zvine musoro.


The Pretenders

LLaMA 2, imhando yemutauro yakakura yakagadzirwa neMeta iyo yakasununguka kushandisa kune zvese zvekutsvaga uye zvekutengesa. Kutungamira vamwe kuti vape LLaMA 2 yakavhurika sosi. Nekudaro, Meta yakaita zvimwe zvirambidzo zvakakomba pakushandiswa kwemuenzaniso wavo. Semuenzaniso, LLaMA 2 haigone kushandiswa kuvandudza chero imwe mhando yemutauro mukuru. Chinzvimbo chinopikisana nechinyakare private collective innovation model yesoftware yakavhurika inosimudzira yakasununguka uye yakazaruka yakazarurwa yekuvandudza kuitira kubatsira kwemunhu wese munharaunda yesoftware.


Meta yakawedzera kukanganisa kushandiswa kwemuenzaniso wavo nekusabvumira kubatanidzwa kweLLaMA 2 nezvigadzirwa zvine 700 miriyoni vashandisi pamwedzi uye nekusaburitsa kuti ndeapi data rakadzidziswa mhando yavo kana kodhi yavakashandisa kuivaka. Nekusaburitsa pachena, Meta iri kuzvivhurira kumibvunzo yekusarurana uye kusarura netsaona. Muenzaniso wakadzidziswa pane rusarura data uchaita kupa mhinduro dzerusarura . Pasina iyo software nharaunda yakakura kukwanisa kuona kana kodhi yakashandiswa kuvaka modhi kuti vaone kana paine dziviriro dzakavakwa mukati kana data rakashandiswa kuidzidzisa, isu tinosara murima pamibvunzo iyi yetsika. Munguva iyo yakabudiswa tsvagiridzo paAI inonyanya kunetseka nekuita pane kururamisira uye kuremekedza iyi obfuscation inonyanya kushungurudza.


Ivo Chaivo

Mistral AI yakawana kuzivikanwa kune yayo yakavhurika-sosi mikuru mhando dzemitauro, kunyanya Mistral 7B uye Mixtral 8x7B. Iyo kambani inoyedza kuona kuwanikwa kwakafara kune yayo AI modhi, inokurudzira kuongorora, kugadziridzwa, uye kushandiswazve neyakavhurika software nharaunda.


vLLM inomirira "vectorized low-latency model serving" uye iraibhurari yakavhurika-yakagadzirirwa kukurumidza uye kukwirisa mamodheru emitauro (LLMs). Icho chishandiso chine simba chinogona kuvandudza zvakanyanya kuita uye kushandiswa kweLLMs. Izvi zvinoita kuti ive yakakosha pfuma yevagadziri vanoshanda pane dzakasiyana siyana dzeAI application, kubva kuma chatbots uye chaiwo vabatsiri kune kugadzira zvemukati uye kodhi kodhi. Zvakanyanya zvekuti, Mistral inokurudzira kushandisa vLLM sevhavha yekufungidzira ye7B uye 8x7B modhi.


EleutherAI isiri-purofiti AI yekutsvagisa lab yakakura kubva kuDiscord server yekukurukura GPT-3 kune inotungamira isiri-purofiti sangano rekutsvagisa. Iri boka rinozivikanwa nebasa raro mukudzidzisa uye kusimudzira yakavhurika sainzi maitiro mu Natural Language Processing. Vakaburitsa akasiyana akavhurika-sosi emitauro mikuru mhando uye vanobatanidzwa mumapurojekiti ekutsvagisa ane chekuita neAI kurongeka uye kududzira. Zvavo LM-Harness purojekiti ingangove ndiyo inotungamira yakavhurika-sosi yekuongorora yemhando dzemitauro.


Phi-2 ndeyeMicrosoft's LLM inobaya pamusoro pehuremu hwayo. Yakadzidziswa musanganiswa wezvinyorwa zvekugadzira uye mawebhusaiti akapepetwa, modhi iyi diki, asi ine simba inokunda pamabasa akaita sekupindura mibvunzo, kupfupikisa, nekushandura. Chii chinonyatso kusiyanisa Phi-2 ndiko kutarisa kwayo kufunga uye kunzwisisa mutauro, zvichitungamira mukuita zvinokatyamadza kunyangwe pasina hunyanzvi hwekugadzirisa.


Mazhinji anokwanisa akavhurika-sosi embedding modhi ari kusimbisa iyo yakazara yakavhurika-sosi generative AI nzvimbo. Aya ndiwo azvino mamiriro-ye-the-art ekuvhura sosi uye anosanganisira UAE-Hombe-V1 uye mitauro yakawanda-e5-yakakura .


Kune akawanda akawanda mumunda unoramba uchikura. Iyi rondedzero ine mashoma ingori mavambo.


Open Source Drives Innovation

Kumbundikira huzivi hwehunyanzvi hwakavhurika hutsva, makambani anotora chikamu mune yakavhurika-sosi software yekuvandudza anopikisa tsika dzechinyakare dzekukwikwidza mukana nekubvuma izvozvo. haasi ese akanaka kodhi kana mazano makuru anogara mukati mesangano ravo . Iyi shanduko inotsigira iyo nharo iyo yakagovana hunyanzvi mukati meyakavhurika-sosi ecosystem inotungamira kukurumidza kukura kwemusika, ichipa kunyange madiki mafemu esoftware ane mari shoma yeR&D mukana wekubatsira kubva kuR&D spillovers iripo mune yakavhurika-sosi software. Izvi zvinodaro nekuti, mukupesana neyechinyakare outsourcing, yakavhurika innovation inowedzera zviwanikwa zvemukati nekusimudzira hungwaru hwenharaunda, pasina kudzikisira kuedza kwemukati kweR&D. Zvichireva kuti makambani akavhurika-sosi software haafanire kupa mabhajeti avo kuti vatevedze hutungamiriri hwekufunga uye kodhi kunze kwesangano ravo.


Pamusoro pezvo, makambani akavhurika-sosi software anofambisa hunyanzvi kuburikidza kuburitsa kodhi kare uye kazhinji , tichiziva kuwedzera kwemaitiro ekuvandudza munharaunda yesoftware. Zvese zvekutaura chimwe chinhu chatozivikanwa nevakawanda: Vhura Source Software inotyaira hunyanzvi.


Open Source Fosters Kubatana

Kuburikidza networking munharaunda yakavhurika-sosi software, vatengesi vanokwanisa kuzadzisa zvinangwa zvenguva pfupi uye zvenguva refu. Zvinangwa zvenguva pfupi purofiti inovaka makambani uye zvibodzwa zvenguva refu zvinovatsigira. Panguva imwecheteyo, iyi network yekuedza inosimudzira iyo network pachayo - kuikurira kune anotevera muzvinabhizimusi. Zvinonyatsozivikanwa kuti ma-open-source platforms anopa mukana wekuwana kodhi yekodhi, zvichiita kuti vagadziri vagadzire kukwidziridzwa, plug-ins uye zvimwe zvidimbu zvepurogiramu uye vashandise maererano nezvavanoda. Iyi chaiyo mhando yekubatana yakawana boom nekutorwa kwakakura kweKubernetes neruzhinji software nharaunda. Iye zvino kupfuura nakare kose, matekinoroji emazuva ano anoshanda pamwe chete pasina kupokana uye anogona kuva mumaminitsi pamwe chete chero kupi zvako.


Makambani makuru eBig Tech anobvuma kubatana kwakadzama uku kwakavakirwa munharaunda yakavhurika-sosi kana vaburitsa pachena masisitimu, maraibhurari, nemitauro yavakagadzira kuchengetedza nekuvandudza maturusi emukati. Kuita izvi kunodzamisa dziva revagadziri vanokwanisa kushanda pane zvigadzirwa zvavo uye votanga kuseta mwero wekuti matekinoroji akafanana anofanira kushanda sei. Chinyorwa chimwe chetecho cheAtlantic chinotora muvambi weMeta Mark Zuckerberg achiti "zvave zvakakosha kwatiri kuti tipe izvo nekuti iye zvino vese vanovandudza indasitiri vari kushandisa maturusi atiri kushandisawo mukati".


Open Source Begets Open Source

Izvi ndizvo zvinhu nei tichiwanzoona kuwirirana pakati pemakambani akavhurika-source. Vhura-sosi AI neML makambani anozongogadzira zvigadziriso nezvimwe zvakavhurika-sosi zvigadzirwa kubva kune ekutanga zvigadzirwa senge chengetedzo yechinhu kuenda kumusoro-kumusoro stack kune maturusi ekuona. Kana imwe yakavhurika-sosi kambani inoenda kumberi, isu tese tinoita. Iyi yakabatana uye yakasanganiswa nzira ingangove yedu yakanakisa bheji yekugadzira AI iyo inotora yakatarisana nevanhu. Aya masimba echisikigo ari mumusika anoda yakavhurika sosi AI yakasanganiswa nehunhu hweakavhurika sosi software yekuvandudza uye kubatana kunotyaira iyo AI data stack yakavhurika sosi.


Ndokumbirawo ubatane uye ubatsire kunhaurirano iyi uye nharaunda yedu nekutitumira email pa [email protected] kana kutitumira meseji pane yedu Slack chiteshi .


Zvakare zvakabudiswa pano .