Get the most recent info and news about GONGHUI on HackerNoon, where 10k+ technologists publish stories for 4M+ monthly readers.

实名制，建筑实名制，人脸考勤，工地考勤，智慧工地，人脸识别技术，数据分析、移动考勤设备，虹膜考勤，建筑工地，工地管理，工人管理，发工资

GONGHUI

gonghui

The Automobile Rainfall Sensor Market Report also includes a competitive landscape and in-depth analyses of the key industry participants [ De Amertek, Safelite, Xi'an Gonghui Electronic ...

Highlights 2030 Automobile Rainfall Sensor Market: Regional Growth and New Advancement

In 2021, hosted the first-ever awards!! HackerNoon Startup of the Year The goal of this campaign was to give recognition to the hardworking startups who pulled through the pandemic -- growing and thriving (despite all of the challenges). More than 44,000 startups were nominated all across the globe! They were selected from over 4,553 cities, with a total number of * cough * “4 billion” votes. Insane, right? To see who is a winner in each respective city, visit and pick a city. The name at the top of the list is the winner. (Compromised awards are under review. Cities with tie votes will be updated to have two winners!) startups.hackernoon.com The will announce the winners per region in their respective cities. Startups Winners Announcement series Here are the winners in the : Asia region Top Startup Cities in East Asia Seoul The Startup of the Year in is with 377 votes! Seoul dable Central is the Startup of the Year! It came out ahead with 121 votes. UpNow Central Sheung Wan came out as the Startup of the Year in with 154 votes. Votee Sheung Wan Tokyo The Startup of the Year in is with 41 votes! Tokyo ACES Wan Chai The Startup of the Year in is with 54 votes! Wan Chai Zetl Osaka, Japan In , is the winner! Osaka Nanophoton Taiwan came out as the Startup of the Year in ! Tico Taiwan Dongcheng, China In , is declared the Startup of the Year! Dongcheng Waiju Taipei came out as the Startup of the Year in ! Tico Taipei Akasaka In , is the winner! Akasaka WAKUWAKU Chuo In , is declared the Startup of the Year! Chuo GO-NET Ginza came out as the Startup of the Year in ! Netyear Ginza Kanazawa In , is the winner! Kanazawa Granzella Minami-aoyama In , is declared the Startup of the Year! Minami-aoyama Tokyo6 Entertainment Shibuya came out as the Startup of the Year in ! Hupro Japan Shibuya Toranomon In , is the winner! Toranomon Small Worlds Toshima In , is declared the Startup of the Year! Toshima Altplus Guangzhou, China came out as the Startup of the Year in ! Leyaoyao Guangzhou Hong Kong, Hong Kong In , is declared the Startup of the Year! Hong Kong Episode Six Kunming In , is the winner! Kunming Green A Sapporo In , is declared the Startup of the Year! Sapporo Polar Star Space Shirokanedai came out as the Startup of the Year in ! Nupp1 Shirokanedai Wuhan In , is the winner! Wuhan CSICEE Baoan, China In , is declared the Startup of the Year! Baoan Jumper Baoshan, China In , is declared the Startup of the Year! Baoshan Renren Games Chengdu, China came out as the Startup of the Year in ! Ju You Xi Chengdu Fujisawa, Japan In , is the winner! Fujisawa Scohia Pharma Fukuoka, Japan In , is declared the Startup of the Year! Fukuoka Kyulux Haidian, China came out as the Startup of the Year in ! 51vv Haidian Hongkou, China In , is the winner! Hongkou Kidstone Jiading, China In , is declared the Startup of the Year! Jiading IMRobotic Kawasaki, Japan came out as the Startup of the Year in ! QD Laser, Inc. Kawasaki Kyoto, Japan In , is declared the Startup of the Year! Kyoto Hacarus Minato, Japan In , is the winner! Minato Visionary Fun Nagoya, Japan came out as the Startup of the Year in ! Prodrone Nagoya Ningbo, China The winner in is . Ningbo OlymTech Corporation Aomori In , is declared the Startup of the Year! Aomori Forte Japan Bandai-cho In , is the winner. Bandai-cho Delta-Fly Pharm Changchun In , the Startup of the Year is . Changchun Kaidi Animation Fuchu In , is declared the Startup of the Year! Fuchu TMS Fukuoka-shi The winner in is . Fukuoka-shi SkyDisc Fukushima In , the Startup of the Year is . Fukushima Matsuri Technologies Gotanda In , is the winner. Gotanda Basset Hachioji In , is declared the Startup of the Year! Hachioji Adriakaim Harbin The winner in is J . Harbin oining Technology Iwaki In , is the winner. Iwaki Tao Engineering Izumo In , the Startup of the Year is . Izumo PuREC Kagoshima In , is declared the Startup of the Year! Kagoshima Farmers Support Kamakura In , the Startup of the Year is . Kamakura KAYAC Kami-meguro The winner in is . Kami-meguro Buzzreach Kanagawa In , is the winner. Kanagawa LoiLo Kashiwa In , the Startup of the Year is . Kashiwa Intelligent Surfaces Kita In , is declared the Startup of the Year! Kita Ax Robotix Kobe The winner in is . Kobe Coconomi Koriyama In , the Startup of the Year is . Koriyama Tocoton Kumamoto In , is the winner. Kumamoto Bloom Technology Kunitachi In , is declared the Startup of the Year! Kunitachi Trys Liaocheng The winner in is . Liaocheng Jinzheng Animation Minami In , is declared the Startup of the Year! Minami ATLAB Miyazaki In , is the winner. Miyazaki Caster Nagano In , is declared the Startup of the Year! Nagano Precision Forestry Nagaoka The winner in is . Nagaoka Plant Form Nihombashi-hamacho In , the Startup of the Year is . Nihombashi-hamacho Shizen Energy Niigata In , is declared the Startup of the Year! Niigata UniBio Japan Nishi-shinagawa In , is the winner. Nishi-shinagawa Play Heart Okayama In , is the winner! Okayama Arch Farm Okinawa In , is declared the Startup of the Year! Okinawa BlogNinja Otemachi In , the Startup of the Year is . Otemachi beBit, Inc Qingdao Shi In , is the winner! Qingdao Shi Manyoubang Quanzhou In , is declared the Startup of the Year! Quanzhou KungFu Animation Group Roppongi The winner in is . Roppongi Holo-X Saitama In , the Startup of the Year is . Saitama GameTector Sendai In , is the winner! Sendai Sendai Smart Machines Setagaya In , is declared the Startup of the Year! Setagaya Skyestate Shenzhen In , the Startup of the Year is . Shenzhen Aiator Shinjuku In , is declared the Startup of the Year! Shinjuku Scalar Shizuoka In , is the winner! Shizuoka PiPhotonics Sumida The winner in is . Sumida Holotch Tachikawa In , the Startup of the Year is . Tachikawa PlusOne Takamatsu In , is declared the Startup of the Year! Takamatsu Ken Robotec Tokushima In , is the winner! Tokushima DennoKotsu Toyonaka In , the Startup of the Year is . Toyonaka FISH BIOTECH Tsukuba In , is declared the Startup of the Year! Tsukuba WARPSPACE Wakayama In , the Startup of the Year is . Wakayama 4D Sensor Xiangzhou In , is the winner! Xiangzhou ALLiN Edutech Group Xianyang The winner in is . Xianyang TONLY Xiaoshan In , is declared the Startup of the Year! Xiaoshan GONGHUI Yamaguchi In , the Startup of the Year is . Yamaguchi Archis Yangpu The winner in is . Yangpu Tmxmall Yau Tsim Mong In , is the winner! Yau Tsim Mong Airnugget Yeoksamdong In , the Startup of the Year is . Yeoksamdong WizSchool Yichang In , is declared the Startup of the Year! Yichang Hubei Kento Electronic Yokohama In , is the winner! Yokohama Next Innovation Yubei In , the Startup of the Year is . Yubei Ophiux Network Yueqing The winner in is . Yueqing Yueqing Easythink Media Zhuhai In , is the winner! Zhuhai Aijuba Hongo In , the Startup of the Year is . Hongo Smile Robotics, Inc Admiralty In , is declared the Startup of the Year! Admiralty BUNCH Southern In , the Startup of the Year is . Southern Retykle Yongdungpo In , is the winner! Yongdungpo Push News Taichung In , is declared the Startup of the Year! Taichung Wondercise Cyberport, Hong Kong In , the Startup of the Year is . Cyberport Animoca Brands Hefei, China In , is the winner! Hefei Tsinglink New Territories, Hong Kong The winner in is . New Territories, Hong Kong Zeek Dezhou In , the Startup of the Year is . Dezhou Dezhou Baji Kitakyushu In , is declared the Startup of the Year! Kitakyushu Reif Seongnam In , is the winner! Seongnam EOFlow Yanshi In , the Startup of the Year is . Yanshi CASI Vision Top Startup Cities in South Asia Hyderabad, India The Startup of the Year in is with 962 votes Hyderabad Quixy Lahore, Pakistan is the Startup of the Year! It came out ahead with 186 votes. SmartWindows Lahore Bangalore, India When it comes to , is the Startup of the Year with 210 votes! Bangalore vBridge Hub Pune, India couldn’t be beaten for Startup of the Year in , it won with 129 votes! InfraCloud Pune Jaipur, India The Startup of the Year in is with 166 votes Jaipur Emizen Tech Lucknow, India is the Startup of the Year! It came out ahead with 279 votes. Keeros Superfoods Lucknow Noida, India came out as the Startup of the Year in with 156 votes! Bagisto Noida Mumbai, India When it comes to , is the Startup of the Year with 96 votes! Mumbai Sequretek Sylhet couldn’t be beaten for Startup of the Year in , it won with 122 votes! DataXpie Sylhet Mylapore, India In , is the winner! Mylapore Yalimart Goa, India In , the Startup of the Year is Goa Filter Coffee Delhi, India In , is declared the Startup of the Year! Delhi EkAnek Networks Karachi, Pakistan The winner in is Karachi Bykea Ahmedabad, India In , is the winner Ahmedabad MageComp Dhaka, Bangladesh The winner in is Dhaka SOLshare Islamabad, Pakistan In Islamabad, is declared the Startup of the Year! TAG Gurgaon, India In , the Startup of the Year is Gurgaon ixigo Bengaluru, India In , is the winner! Bengaluru Prakshep Private Limited Haryana, India couldn’t be beaten for Startup of the Year in ! Footprints Childcare Haryana Kolkata, India In , is the winner! Kolkata Wow! Momo New Delhi, India In , is declared the Startup of the Year! New Delhi Rusk Media Indore, India The winner in is Indore Chattar Patar Kormangala In , is the winner Kormangala Sanctum Technologies Ghaziabad came out as the Startup of the Year in Craftfurnish.com Ghaziabad! Mohali In , the Startup of the Year is Mohali DataKund Mysore The Startup of the Year in is Mysore Excelsoft Karnal came out as the Startup of the Year in ! Dunar Karnal Kolhapur In , is the winner! Kolhapur Zanvar Group Patiya In , the Startup of the Year is Patiya Kloud Project Kathmandu In , is declared the Startup of the Year! Kathmandu Vairav Technology Bangalore City, India In is the winner! Bangalore City, PagarBook Ernakulam The winner in is Ernakulam Epixel Solutions Colombo, Sri Lanka couldn’t be beaten for Startup in the Year in MAs Foods Colombo Andheri, India When it comes to , is the Startup of the Year! Andheri DoorMint Kanpur, India came out as the Startup of the Year in ! ServiceWalaa Kanpur Faisalabad In , is the winner! Faisalabad DigiKhata Nasik The Startup of the Year in is Nasik Sahyadri Farms Patna came out as the Startup of the Year in ! Asvin Tech Patna Chennai, India In , is the winner! Chennai Agnikul Cosmos Faridabad, India In , is declared the Startup of the Year! Faridabad UClean Panjim, India The winner in is Panjim TempoGO Ranchi, India In , is the winner Ranchi Osam Dairy Surat, India In , is declared the Startup of the Year! Surat Wishbook Thane, India In , is the winner! Thane Delight Foods Trivandrum, India came out as the Startup of the Year in ! GenRobotic Trivandrum Vijayawada, India In , the Startup of the Year is Vijayawada Eruvaka Technologies Visakhapatnam, India In , Ltd is declared the Startup of the Year! Visakhapatnam Greenline Labs Pvt Ahmadabad In , is the winner! Ahmadabad KiwiQA Services Bandra came out as the Startup of the Year in ! Car Club Bandra Bombay In , is the winner! Bombay Locobuddy Mobile Technology (Sportobuddy) Cochin In , the Startup of the Year is Cochin Tuttifrutti Interactive Gandhinagar In , is declared the Startup of the Year! Gandhinagar Kroop AI Guwahati In , the Startup of the Year is Guwahati GNRC Hospitals Jamshedpur In , is declared the Startup of the Year! Jamshedpur Intelliber Kabul The winner in is Kabul Miracle Shop (Vocinno Technology) Karur In , is the winner Karur Karur Vysya Bank Kochi The winner in is Kochi BestDoc Kozhikode In , is declared the Startup of the Year! Kozhikode OfficeKit HR Ludhiana In , the Startup of the Year is Ludhiana Trendy Beat Network Madhapur In , is the winner! Madhapur Head Digital Works Mangalore When it comes to , is the Startup of the Year Mangalore Hangyo Nagpur came out as the Startup of the Year in ! UPrudence Agro Nagpur Rawalpindi The Startup of the Year in is Rawalpindi Pro Options Marketing Rishikesh came out as the Startup of the Year in ! Descatuk Rishikesh Secunderabad couldn’t be beaten for Startup of the Year in Prakriti Biosystems Engineering Secunderabad Tirupur In , is the winner! Tirupur Tubeknit Fashions Udupi The winner in is Udupi Krishitantra Top Startup Cities in Southeast Asia Singapore, Singapore The Startup of the Year in is with 6556 votes! Singapore Cake DeFi Hanoi, Vietnam is the Startup of the Year! It came out ahead with 683 votes. DeFi For You Hanoi Kuala Lumpur, Malaysia came out as the Startup of the Year in with 109 votes! Trambellir Kuala Lumpur Pasig, Philippines When it comes to , . is the Startup of the Year with 110 votes! Pasig Quickreach Inc Bangkok, Thailand couldn’t be beaten for Startup in the Year in , it won with 60 votes! Perception Codes Bangkok Johor Bahru In , the Startup of the Year is . Johor Bahru AGR1 Bandung, Indonesia In , is declared the Startup of the Year! Bandung Prosa Portugal The winner in is . Portugal SCEMAI Tangerang, Indonesia In , is the winner Tangerang Yummy Corp Jakarta, Indonesia In , is the winner! Jakarta Tokocrypto Dki Jakarta, Indonesia In , is declared the Startup of the Year! Dki Jakarta Limakilo Bangkok Metropolis In , is the winner! Bangkok Meticuly Medan The winner in is ! Medan DIKA Manila, Philippines In , is declared the Startup of the Year! Manila PawnHero Phnom Penh, Cambodia In , the Startup of the Year is Phnom Penh vKirirom Bali In , is the winner! Bali Radius App Penang When it comes to , is the Startup of the Year Penang EasyParcel Surabaya came out as the Startup of the Year in ! Super Surabaya Setiabudi, Indonesia The Startup of the Year in is Setiabudi Chilibeli Cebu City came out as the Startup of the Year in MiCab Cebu City! Jawa couldn’t be beaten for Startup in the Year in DAUR Jawa Ho Chi Minh City, Vietnam In , is the winner! Ho Chi Minh City Pharmacity Selangor, Malaysia is the Startup of the Year! BabyDash Selangor Jakarta Pusat, Indonesia In , is the winner! Jakarta Pusat StickEarn Semarang When it comes to , is the Startup of the Year! Semarang Food Bear Petaling Jaya, Malaysia The winner in is . Petaling Jaya Deemples Kebayoran Baru, Indonesia couldn’t be beaten for Startup in the Year in ! Yogrt Kebayoran Baru Kuningan The winner in is . Kuningan Prinzio Bukit Merah came out as the Startup of the Year in ! DC Alliance Bukit Merah Huai Khwang In , the Startup of the Year is . Huai Khwang AppMan Co.,Ltd Kuta In , is declared the Startup of the Year! Kuta Gringgo Mandaluyong came out ahead as the Startup of the Year! Work Inspire Mandaluyong Midview City In , is the winner! Midview City BioMers Phuket The Startup of the Year in is ! Phuket Sapahn Yangon, Myanmar The winner in is . Yangon Wave Money Denpasar When it comes to , is the Startup of the Year! Denpasar Revasi Nakhon Ratchasima, Thailand The winner in is . Nakhon Ratchasima Siam Lottery co., Ltd Taguig, Philippines In , is the winner! Taguig PayMongo Bogor came out as the Startup of the Year in ! TIRANYX Bogor Senai, Malaysia won as the Startup of the Year. Nutrition Technologies Senai Bekasi Kota couldn’t be beaten for Startup in the Year in ! 8villages Bekasi Kota Top Startup Cities in Middle East Tel Aviv, Israel The Startup of the Year in is with 1,065 votes! Tel Aviv hyro Beirut, Lebanon is the Startup of the Year! It came out ahead with 1,276 votes. Hovi Digital Lab Beirut Riyadh, Saudi Arabia With 350 votes, came out as the Startup of the Year in ! Flicron Riyadh Tel Aviv-yafo, Israel When it comes to , is the Startup of the Year with 167 votes! Tel Aviv-yafo Cymbio Haifa, Israel couldn’t be beaten for Startup in the Year in , it won with 183 votes! Pico Haifa Amman, Jordan In , with 141 votes, is the winner! Amman Edexy Dubai, United Arab Emirates In , the Startup of the Year is with 74 votes. Dubai Ziina Doha, Qatar In , is declared the Startup of the Year! Doha SkipCash Tehran, Iran The winner in is . BeyondBoard AR Tehran Jerusalem, Israel In , is the winner! Jerusalem SolidBlock Rishon Le Zion The Startup of the Year in is ! Rishon Le Zion Passparto Ness Ziona, Israel is the Startup of the Year! Soapy Ness Ziona Kuwait, Kuwait came out as the Startup of the Year in ! Brapper Shop Kuwait Manama, Bahrain couldn’t be beaten for Startup in the Year in ! Doctori Manama Lod, Israel is the winner in ! Phinergy Lod Agudat Israel, Israel When it comes to is the Startup of the Year with [vote ] votes! Agudat Israel, Aqaurius Engines Beersheba, Israel In , the Startup of the Year is . Beersheba Visual Estate Ltd Giv'atayim, Israel In , is declared the Startup of the Year! Giv'atayim WSC Sports Modi'in, Israel The winner in is . Modi'in Loginno Nazareth, Israel In , is the winner! Nazareth AR Guide In Medical Ramat Gan, Israel The Startup of the Year in is . Ramat Gan Datos Health Baghdad When it comes to , is the Startup of the Year! Baghdad Mishwar Khobar In , the Startup of the Year is . Khobar Garage Misgav couldn’t be beaten for Startup in the Year in ! Eden Shield Misgav Sharjah came out as the Startup of the Year in ! Bookends Sharjah Affula In , the Startup of the Year is . Affula eMotion Technologies Bene Beraq, Israel In , is the winner Bene Beraq Reflectiz Caesarea, Israel In , the Startup of the Year is . Caesarea CardiacSense Dubayy In , is declared the Startup of the Year! Dubayy North Ladder Muscat couldn’t be beaten for Startup in the Year in ! iLab Marine Muscat Tirat Carmel In , the Startup of the Year is . Tirat Carmel PassCall Advanced Technologies Hod Hasharon, Israel The winner in is . Hod Hasharon Idomoo Holon, Israel came out ahead as the Startup of the Year! OptimalPlus Holon Jeddah, Saudi Arabia When it comes to , is the Startup of the Year! Jeddah Arabian Combustion Technologies Ramat Hasharon, Israel is the Startup of the Year! Lumen Ramat Hasharon Al Khobar came out as the Startup of the Year in ! Swyft Al Khobar Bet Shemesh In , is the winner! Bet Shemesh Degania Medical Binyamina When it comes to , is the Startup of the Year! Binyamina OncoHost Makkah In , the Startup of the Year is Makkah Scimagine Or Akiva Last but not least, couldn’t be beaten for Startup in the Year in the city of ! WMT Or Akiva More Information: If you’re a winner, please answer ! If you’re a reader, participant, just a curious individual, consider answering one of our interviews . this interview here Read the FAQs about or . Startups here here To see all of the winners you may visit , pick any city and view the name that appears at the top. this site If you’re interested in partnering with us, we invite you to look through some of these or reach out to our business department. unique sponsorship options Perhaps creating your very own tickles your fancy or maybe you have a whole new idea for how we can partner! writing contest Thank you to all of our sponsors! We truly appreciate your contribution to the tech world and thus the future! The Startups Awards are sponsored by: , , , , , , , , , , Blockster Brex FreeCodeCamp LaunchDarkly Coil Udacity Udemy Vercel Asia Pacific Transgender Network Bybit Everscale Network The post was written by Kushal Tamrakar and Valerie Ejegi, edited by Hang Ngo. If you have any questions or concerns or would like to report a discrepancy please email ellen@hackernoon.com.

Meet the Winners of Startups in Asia

Multilingual Coarse Political Stance Classification of Media: Acknowledgments and References

মিডিয়ার বহুভাষিক মোটা রাজনৈতিক অবস্থানের শ্রেণীবিভাগ: স্বীকৃতি এবং উল্লেখ

Mehrsprachige grobe politische Haltung Klassifizierung von Medien: Danksagungen und Referenzen

Clasificación multilingüe de posturas políticas generales de los medios: reconocimientos y referencias

Classification multilingue grossière des positions politiques des médias : remerciements et références

बहुभाषी असभ्य राजनीतिक रुख मीडिया का वर्गीकरण: आभार और संदर्भ

多言語メディアの粗い政治的立場の分類: 謝辞と参考文献

미디어의 다국어 거친 정치적 입장 분류: 감사의 글 및 참고 자료

Classificação Multilíngue da Posição Política Grosseira da Mídia: Agradecimentos e Referências

Многоязычная грубая политическая классификация СМИ: благодарности и ссылки

Medyanın Çok Dilli Kaba Siyasi Duruş Sınıflandırması: Teşekkür ve Referanslar

Phân loại quan điểm chính trị thô sơ đa ngôn ngữ của phương tiện truyền thông: Lời cảm ơn và tài liệu tham khảo

多语言媒体粗略政治立场分类：致谢与参考文献

This paper is available on arxiv under CC BY-NC-SA 4.0 DEED license. Authors: (1) Ke Hong, Tsinghua University & Infinigence-AI; (2) Guohao Dai, Shanghai Jiao Tong University & Infinigence-AI; (3) Jiaming Xu, Shanghai Jiao Tong University & Infinigence-AI; (4) Qiuli Mao, Tsinghua University & Infinigence-AI; (5) Xiuhong Li, Peking University; (6) Jun Liu, Shanghai Jiao Tong University & Infinigence-AI; (7) Kangdi Chen, Infinigence-AI; (8) Yuhan Dong, Tsinghua University; (9) Yu Wang, Tsinghua University. Table of Links Abstract & Introduction Backgrounds Asynchronized Softmax with Unified Maximum Value Flat GEMM Optimization with Double Buffering Heuristic Dataflow with Hardware Resource Adaption Evaluation Related Works Conclusion & References 8 Conclusions We propose FlashDecoding++, a fast Large Language Model inference engine in this paper. FlashDecoding++ accelerates mainstream LLMs with multiple hardware backend support. FlashDecoding++ proposes three novel designs: the asynchronized softmax with unified max value, the flat GEMM optimization with double buffering, and the heuristic dataflow with hardware resource adaption, achieving up to × and × speedup on NVIDIA and AMD GPUs compared with Hugging Face implementations. FlashDecoding++ also achieves an average of × speedup compared with state-of-the-art LLM inference engines, FlashDecoding, on various LLMs. 4.86 2.18 1.37 References [1] Hugo Touvron, Louis Martin, Kevin Stone, Peter Albert, Amjad Almahairi, Yasmine Babaei, Nikolay Bashlykov, Soumya Batra, Prajjwal Bhargava, Shruti Bhosale, et al. Llama 2: Open foundation and fine-tuned chat models. arXiv preprint arXiv:2307.09288, 2023. [2] Arun James Thirunavukarasu, Darren Shu Jeng Ting, Kabilan Elangovan, Laura Gutierrez, Ting Fang Tan, and Daniel Shu Wei Ting. Large language models in medicine. Nature medicine, 29(8):1930–1940, 2023. [3] Rohan Anil, Andrew M. Dai, Orhan Firat, Melvin Johnson, Dmitry Lepikhin, Alexandre Passos, Siamak Shakeri, Emanuel Taropa, Paige Bailey, Zhifeng Chen, Eric Chu, Jonathan H. Clark, Laurent El Shafey, Yanping Huang, Kathy Meier-Hellstern, Gaurav Mishra, Erica Moreira, Mark Omernick, Kevin Robinson, Sebastian Ruder, Yi Tay, Kefan Xiao, Yuanzhong Xu, Yujing Zhang, Gustavo Hernandez Abrego, Junwhan Ahn, Jacob Austin, Paul Barham, Jan Botha, James Bradbury, Siddhartha Brahma, Kevin Brooks, Michele Catasta, Yong Cheng, Colin Cherry, Christopher A. Choquette-Choo, Aakanksha Chowdhery, Clément Crepy, Shachi Dave, Mostafa Dehghani, Sunipa Dev, Jacob Devlin, Mark Díaz, Nan Du, Ethan Dyer, Vlad Feinberg, Fangxiaoyu Feng, Vlad Fienber, Markus Freitag, Xavier Garcia, Sebastian Gehrmann, Lucas Gonzalez, Guy Gur-Ari, Steven Hand, Hadi Hashemi, Le Hou, Joshua Howland, Andrea Hu, Jeffrey Hui, Jeremy Hurwitz, Michael Isard, Abe Ittycheriah, Matthew Jagielski, Wenhao Jia, Kathleen Kenealy, Maxim Krikun, Sneha Kudugunta, Chang Lan, Katherine Lee, Benjamin Lee, Eric Li, Music Li, Wei Li, YaGuang Li, Jian Li, Hyeontaek Lim, Hanzhao Lin, Zhongtao Liu, Frederick Liu, Marcello Maggioni, Aroma Mahendru, Joshua Maynez, Vedant Misra, Maysam Moussalem, Zachary Nado, John Nham, Eric Ni, Andrew Nystrom, Alicia Parrish, Marie Pellat, Martin Polacek, Alex Polozov, Reiner Pope, Siyuan Qiao, Emily Reif, Bryan Richter, Parker Riley, Alex Castro Ros, Aurko Roy, Brennan Saeta, Rajkumar Samuel, Renee Shelby, Ambrose Slone, Daniel Smilkov, David R. So, Daniel Sohn, Simon Tokumine, Dasha Valter, Vijay Vasudevan, Kiran Vodrahalli, Xuezhi Wang, Pidong Wang, Zirui Wang, Tao Wang, John Wieting, Yuhuai Wu, Kelvin Xu, Yunhan Xu, Linting Xue, Pengcheng Yin, Jiahui Yu, Qiao Zhang, Steven Zheng, Ce Zheng, Weikang Zhou, Denny Zhou, Slav Petrov, and Yonghui Wu. Palm 2 technical report, 2023. [4] Jan Clusmann, Fiona R Kolbinger, Hannah Sophie Muti, Zunamys I Carrero, Jan-Niklas Eckardt, Narmin Ghaffari Laleh, Chiara Maria Lavinia Löffler, Sophie-Caroline Schwarzkopf, Michaela Unger, Gregory P Veldhuizen, et al. The future landscape of large language models in medicine. Communications Medicine, 3(1):141, 2023. [5] Can Cui, Yunsheng Ma, Xu Cao, Wenqian Ye, and Ziran Wang. Receive, reason, and react: Drive as you say with large language models in autonomous vehicles. arXiv preprint arXiv:2310.08034, 2023. [6] OpenAI. Openai pricing. [Online], 2023. https://openai.com/pricing. [7] Nerdynav. Up-to-date chatgpt statistics and user numbers [oct 2023]. [Online], 2023. https://nerdynav.com/ chatgpt-statistics. [8] AFZAL AHMAD DYLAN PATEL. The inference cost of search disruption - large language model cost analysis. [Online], 2023. https://www.semianalysis.com/p/the-inference-cost-of-search-disruption. [9] Reza Yazdani Aminabadi, Samyam Rajbhandari, Ammar Ahmad Awan, Cheng Li, Du Li, Elton Zheng, Olatunji Ruwase, Shaden Smith, Minjia Zhang, Jeff Rasley, et al. Deepspeed-inference: enabling efficient inference of transformer models at unprecedented scale. In SC22: International Conference for High Performance Computing, Networking, Storage and Analysis, pages 1–15. IEEE, 2022. [10] Ying Sheng, Lianmin Zheng, Binhang Yuan, Zhuohan Li, Max Ryabinin, Beidi Chen, Percy Liang, Christopher Re, Ion Stoica, and Ce Zhang. Flexgen: High-throughput generative inference of large language models with a single gpu. 2023. [11] Woosuk Kwon, Zhuohan Li, Siyuan Zhuang, Ying Sheng, Lianmin Zheng, Cody Hao Yu, Joseph Gonzalez, Hao Zhang, and Ion Stoica. Efficient memory management for large language model serving with pagedattention. In Proceedings of the 29th Symposium on Operating Systems Principles, pages 611–626, 2023. [12] Sensetime. Openppl: A high-performance deep learning inference platform. [Online], 2023. https://openppl. ai/home. [13] Tri Dao, Daniel Haziza, Francisco Massa, and Grigory Sizov. Flash-decoding for long-context inference. [Online], 2023. https://crfm.stanford.edu/2023/10/12/flashdecoding.html. [14] Neal Vaidya, Fred Oh, and Nick Comly. Optimizing inference on large language models with nvidia tensorrt-llm, now publicly available. [Online], 2023. https://github.com/NVIDIA/TensorRT-LLM. [15] Sensetime. A light and fast inference service for llm. [Online], 2023. https://github.com/ModelTC/ lightllm. [16] Text generation inference: Fast inference optimize for llms. [Online], 2023. https://github.com/ huggingface/text-generation-inference/. [17] Mlc llm: Machine learning compilation for large language models. [Online], 2023. https://github.com/ mlc-ai/mlc-llm. [18] Tri Dao, Dan Fu, Stefano Ermon, Atri Rudra, and Christopher Ré. Flashattention: Fast and memory-efficient exact attention with io-awareness. Advances in Neural Information Processing Systems, 35:16344–16359, 2022. [19] Tri Dao. Flashattention-2: Faster attention with better parallelism and work partitioning. arXiv preprint arXiv:2307.08691, 2023. [20] Aaron Pham, Chaoyu Yang, Sean Sheng, Shenyang Zhao, Sauyon Lee, Bo Jiang, Fog Dong, Xipeng Guan, and Frost Ming. OpenLLM: Operating LLMs in production, June 2023. [21] Zihang Dai, Zhilin Yang, Yiming Yang, Jaime Carbonell, Quoc V Le, and Ruslan Salakhutdinov. Transformer-xl: Attentive language models beyond a fixed-length context. arXiv preprint arXiv:1901.02860, 2019. [22] Z Dong, T Tang, L Li, and WX Zhao. A survey on long text modeling with transformers. arxiv 2023. arXiv preprint arXiv:2302.14502. [23] Guangxuan Xiao, Yuandong Tian, Beidi Chen, Song Han, and Mike Lewis. Efficient streaming language models with attention sinks. arXiv preprint arXiv:2309.17453, 2023. [24] NVIDIA. cublas: Basic linear algebra on nvidia gpus. [Online], 2017. https://developer.nvidia.com/ cublas. [25] NVIDIA. Cutlass: Cuda templates for linear algebra subroutines. [Online], 2017. https://github.com/ NVIDIA/cutlass. [26] Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N Gomez, Łukasz Kaiser, and Illia Polosukhin. Attention is all you need. Advances in neural information processing systems, 30, 2017. [27] Vinod Nair and Geoffrey E Hinton. Rectified linear units improve restricted boltzmann machines. In Proceedings of the 27th international conference on machine learning (ICML-10), pages 807–814, 2010. [28] Dan Hendrycks and Kevin Gimpel. Gaussian error linear units (gelus). arXiv preprint arXiv:1606.08415, 2016. [29] Prajit Ramachandran, Barret Zoph, and Quoc V Le. Searching for activation functions. arXiv preprint arXiv:1710.05941, 2017. [30] John Bridle. Training stochastic model recognition algorithms as networks can lead to maximum mutual information estimation of parameters. Advances in neural information processing systems, 2, 1989. [31] Stephen Merity, Caiming Xiong, James Bradbury, and Richard Socher. Pointer sentinel mixture models, 2016. [32] NVIDIA. Nvidia tensor core. [Online], 2023. https://www.nvidia.com/en-us/data-center/ tensor-cores/. [33] NVIDIA. Fastertransformer: About transformer related optimization, including bert, gpt. [Online], 2017. https://github.com/NVIDIA/FasterTransformer. [34] Siping Wang. Fastgemv: High-speed gemv kernels. [Online], 2023. https://github.com/wangsiping97/ FastGEMV. [35] Thomas Wolf, Lysandre Debut, Victor Sanh, Julien Chaumond, Clement Delangue, Anthony Moi, Pierric Cistac, Tim Rault, Remi Louf, Morgan Funtowicz, Joe Davison, Sam Shleifer, Patrick von Platen, Clara Ma, Yacine Jernite, Julien Plu, Canwen Xu, Teven Le Scao, Sylvain Gugger, Mariama Drame, Quentin Lhoest, and Alexander Rush. Transformers: State-of-the-art natural language processing. In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing: System Demonstrations, pages 38–45, Online, October 2020. Association for Computational Linguistics. [36] Susan Zhang, Stephen Roller, Naman Goyal, Mikel Artetxe, Moya Chen, Shuohui Chen, Christopher Dewan, Mona Diab, Xian Li, Xi Victoria Lin, Todor Mihaylov, Myle Ott, Sam Shleifer, Kurt Shuster, Daniel Simig, Punit Singh Koura, Anjali Sridhar, Tianlu Wang, and Luke Zettlemoyer. Opt: Open pre-trained transformer language models, 2022. [37] Zhengxiao Du, Yujie Qian, Xiao Liu, Ming Ding, Jiezhong Qiu, Zhilin Yang, and Jie Tang. Glm: General language model pretraining with autoregressive blank infilling. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (Volume 1: Long Papers), pages 320–335, 2022. [38] NVIDIA. Nvidia tensorrt: An sdk for high-performance deep learning inference. [Online]. https://developer. nvidia.com/tensorrt.

FlashDecoding++: Faster Large Language Model Inference on GPUs: Conclusion & References

Software Engineering for OpenHarmony—A Research Roadmap: Conclusion & References

This paper is available on arxiv under CC 4.0 license. . Authors: Gemini Team, Google Table of Links Abstract and Introduction Model Architecture Training Infrastructure Training Dataset Evaluation Responsible Deployment Discussion and Conclusion, References Contributions and Acknowledgments Appendix 8. Contributions and Acknowledgments Leads Rohan Anil, Co-Lead, Text Sebastian Borgeaud, Co-Lead, Text Yonghui Wu, Co-Lead, Text Jean-Baptiste Alayrac, Co-Lead, MM Vision Jiahui Yu, Co-Lead, MM Vision Radu Soricut*, Co-Lead, MM Vision* Johan Schalkwyk, Lead, MM Audio Andrew M. Dai, Co-Lead, Data Anja Hauth*, Co-Lead, Data* Katie Millican, Co-Lead, Data David Silver, Co-Lead, Fine-Tuning Slav Petrov, Co-Lead, Fine-Tuning Melvin Johnson, Lead, Instruction Tuning Ioannis Antonoglou*, Co-Lead, RL Techniques* Julian Schrittwieser, Co-Lead, RL Techniques Amelia Glaese, Lead, Human Data Jilin Chen, Lead, Safety Emily Pitler, Co-Lead, Tool Use Timothy Lillicrap, Co-Lead, Tool Use Angeliki Lazaridou, Co-Lead, Eval Orhan Firat, Co-Lead, Eval James Molloy, Co-Lead, Infra Michael Isard, Co-Lead, Infra Paul R. Barham, Co-Lead, Infra Tom Hennigan, Co-Lead, Infra Benjamin Lee, Co-Lead, Codebase & Parallelism Fabio Viola, Co-Lead, Codebase & Parallelism Malcolm Reynolds, Co-Lead, Codebase & Parallelism Yuanzhong Xu, Co-Lead, Codebase & Parallelism Ryan Doherty, Lead, Ecosystem Eli Collins, Lead, Product Clemens Meyer, Co-Lead, Operations Eliza Rutherford, Co-Lead, Operations Erica Moreira, Co-Lead, Operations Kareem Ayoub, Co-Lead, Operations Megha Goel, Co-Lead, Operations Core Contributors George Tucker Enrique Piqueras Maxim Krikun Iain Barr Nikolay Savinov Ivo Danihelka Becca Roelofs Core Contributors Anaïs White Anders Andreassen Tamara von Glehn Lakshman Yagati Mehran Kazemi Lucas Gonzalez Misha Khalman Jakub Sygnowski Alexandre Frechette Charlotte Smith Laura Culp Lev Proleev Yi Luan Xi Chen James Lottes Nathan Schucher Federico Lebron Alban Rrustemi Natalie Clay Phil Crone Tomas Kocisky Jeffrey Zhao Bartek Perz Dian Yu Heidi Howard Adam Bloniarz Jack W. Rae Han Lu Laurent Sifre Marcello Maggioni Fred Alcober Dan Garrette Megan Barnes Shantanu Thakoor Jacob Austin Gabriel Barth-Maron William Wong Rishabh Joshi Rahma Chaabouni Deeni Fatiha Arun Ahuja Ruibo Liu Yunxuan Li Sarah Cogan Jeremy Chen Core Contributors Chao Jia Chenjie Gu Qiao Zhang Jordan Grimstad Ale Jakse Hartman Martin Chadwick Gaurav Singh Tomar Xavier Garcia Evan Senter Emanuel Taropa Thanumalayan Sankaranarayana Pillai Jacob Devlin Michael Laskin Diego de Las Casas Dasha Valter Connie Tao Lorenzo Blanco Adrià Puigdomènech Badia David Reitter Mianna Chen Jenny Brennan Clara Rivera Sergey Brin Shariq Iqbal Gabriela Surita Jane Labanowski Abhi Rao Stephanie Winkler Emilio Parisotto Yiming Gu Kate Olszewska Yujing Zhang Ravi Addanki Antoine Miech Annie Louis Laurent El Shafey Denis Teplyashin Geoff Brown Elliot Catt Nithya Attaluri Jan Balaguer Jackie Xiang Pidong Wang Zoe Ashwood Anton Briukhov Albert Webson Sanjay Ganapathy Smit Sanghavi Core Contributors Ajay Kannan Ming-Wei Chang Axel Stjerngren Josip Djolonga Yuting Sun Ankur Bapna Matthew Aitchison Pedram Pejman Henryk Michalewski Tianhe Yu Cindy Wang Juliette Love Junwhan Ahn Dawn Bloxwich Kehang Han Peter Humphreys Thibault Sellam James Bradbury Varun Godbole Sina Samangooei Bogdan Damoc Alex Kaskasoli Sébastien M. R. Arnold Vijay Vasudevan Shubham Agrawal Jason Riesa Dmitry Lepikhin Richard Tanburn Srivatsan Srinivasan Hyeontaek Lim Sarah Hodkinson Pranav Shyam Johan Ferret Steven Hand Ankush Garg Tom Le Paine Jian Li Yujia Li Minh Giang Alexander Neitz Zaheer Abbas Sarah York Machel Reid Elizabeth Cole Aakanksha Chowdhery Dipanjan Das Dominika Rogozińska Vitaly Nikolaev Core Contributors Pablo Sprechmann Zachary Nado Lukas Zilka Flavien Prost Luheng He Marianne Monteiro Gaurav Mishra Chris Welty Josh Newlan Dawei Jia Miltiadis Allamanis Clara Huiyi Hu Raoul de Liedekerke Justin Gilmer Carl Saroufim Shruti Rijhwani Shaobo Hou Disha Shrivastava Anirudh Baddepudi Alex Goldin Adnan Ozturel Albin Cassirer Yunhan Xu Daniel Sohn Devendra Sachan Reinald Kim Amplayo Craig Swanson Dessie Petrova Shashi Narayan Arthur Guez Siddhartha Brahma Jessica Landon Miteyan Patel Ruizhe Zhao Kevin Villela Luyu Wang Wenhao Jia Matthew Rahtz Mai Giménez Legg Yeung Hanzhao Lin James Keeling Petko Georgiev Diana Mincu Boxi Wu Salem Haykal Rachel Saputro Kiran Vodrahalli Core Contributors James Qin Zeynep Cankara Abhanshu Sharma Nick Fernando Will Hawkins Behnam Neyshabur Solomon Kim Adrian Hutter Priyanka Agrawal Alex Castro-Ros George van den Driessche Tao Wang Fan Yang Shuo-yiin Chang Paul Komarek Ross McIlroy Mario Lučić Guodong Zhang Wael Farhan Michael Sharman Paul Natsev Paul Michel Yong Cheng Yamini Bansal Siyuan Qiao Kris Cao Siamak Shakeri Christina Butterfield Justin Chung Paul Kishan Rubenstein Shivani Agrawal Arthur Mensch Kedar Soparkar Karel Lenc Timothy Chung Aedan Pope Loren Maggiore Jackie Kay Priya Jhakra Shibo Wang Joshua Maynez Mary Phuong Taylor Tobin Andrea Tacchetti Maja Trebacz Kevin Robinson Yash Katariya Sebastian Riedel Core Contributors Paige Bailey Kefan Xiao Nimesh Ghelani Lora Aroyo Ambrose Slone Neil Houlsby Xuehan Xiong Zhen Yang Elena Gribovskaya Jonas Adler Mateo Wirth Lisa Lee Music Li Thais Kagohara Jay Pavagadhi Sophie Bridgers Anna Bortsova Sanjay Ghemawat Zafarali Ahmed Tianqi Liu Richard Powell Vijay Bolina Mariko Iinuma Polina Zablotskaia James Besley Da-Woon Chung Timothy Dozat Ramona Comanescu Xiance Si Jeremy Greer Guolong Su Martin Polacek Raphaël Lopez Kaufman Simon Tokumine Hexiang Hu Elena Buchatskaya Yingjie Miao Mohamed Elhawaty Aditya Siddhant Nenad Tomasev Jinwei Xing Christina Greer Helen Miller Shereen Ashraf Aurko Roy Zizhao Zhang Ada Ma Angelos Filos Core Contributors Milos Besta Rory Blevins Ted Klimenko Chih-Kuan Yeh Soravit Changpinyo Jiaqi Mu Oscar Chang Mantas Pajarskas Carrie Muir Vered Cohen Charline Le Lan Krishna Haridasan Amit Marathe Steven Hansen Sholto Douglas Rajkumar Samuel Mingqiu Wang Sophia Austin Chang Lan Jiepu Jiang Justin Chiu Jaime Alonso Lorenzo Lars Lowe Sjösund Sébastien Cevey Zach Gleicher Thi Avrahami Anudhyan Boral Hansa Srinivasan Vittorio Selo Rhys May Konstantinos Aisopos Léonard Hussenot Livio Baldini Soares Kate Baumli Michael B. Chang Adrià Recasens Ben Caine Alexander Pritzel Filip Pavetic Fabio Pardo Anita Gergely Justin Frye Vinay Ramasesh Dan Horgan Kartikeya Badola Nora Kassner Subhrajit Roy Ethan Dyer Core Contributors Víctor Campos Alex Tomala Yunhao Tang Dalia El Badawy Elspeth White Basil Mustafa Oran Lang Abhishek Jindal Sharad Vikram Zhitao Gong Sergi Caelles Ross Hemsley Gregory Thornton Fangxiaoyu Feng Wojciech Stokowiec Ce Zheng Phoebe Thacker Çağlar Ünlü Zhishuai Zhang Mohammad Saleh James Svensson Max Bileschi Piyush Patil Ankesh Anand Roman Ring Katerina Tsihlas Arpi Vezer Marco Selvi Toby Shevlane Mikel Rodriguez Tom Kwiatkowski Samira Daruki Keran Rong Allan Dafoe Nicholas FitzGerald Keren Gu-Lemberg Mina Khan Lisa Anne Hendricks Marie Pellat Vladimir Feinberg James Cobon-Kerr Tara Sainath Maribeth Rauh Sayed Hadi Hashemi Richard Ives Yana Hasson YaGuang Li Eric Noland Core Contributors Yuan Cao Nathan Byrd Le Hou Qingze Wang Thibault Sottiaux Michela Paganini Jean-Baptiste Lespiau Alexandre Moufarek Samer Hassan Kaushik Shivakumar Joost van Amersfoort Amol Mandhane Pratik Joshi Anirudh Goyal Matthew Tung Andrew Brock Hannah Sheahan Vedant Misra Cheng Li Nemanja Rakićević Mostafa Dehghani Fangyu Liu Sid Mittal Junhyuk Oh Seb Noury Eren Sezener Fantine Huot Matthew Lamm Nicola De Cao Charlie Chen Contributors Gamaleldin Elsayed Ed Chi Mahdis Mahdieh Ian Tenney Nan Hua Ivan Petrychenko Patrick Kane Dylan Scandinaro Rishub Jain Jonathan Uesato Romina Datta Adam Sadovsky Oskar Bunyan Dominik Rabiej Shimu Wu John Zhang Contributors Gautam Vasudevan Edouard Leurent Mahmoud Alnahlawi Ionut Georgescu Nan Wei Ivy Zheng Betty Chan Pam G Rabinovitch Piotr Stanczyk Ye Zhang David Steiner Subhajit Naskar Michael Azzam Matthew Johnson Adam Paszke Chung-Cheng Chiu Jaume Sanchez Elias Afroz Mohiuddin Faizan Muhammad Jin Miao Andrew Lee Nino Vieillard Sahitya Potluri Jane Park Elnaz Davoodi Jiageng Zhang Jeff Stanway Drew Garmon Abhijit Karmarkar Zhe Dong Jong Lee Aviral Kumar Luowei Zhou Jonathan Evens William Isaac Zhe Chen Johnson Jia Anselm Levskaya Zhenkai Zhu Chris Gorgolewski Peter Grabowski Yu Mao Alberto Magni Kaisheng Yao Javier Snaider Norman Casagrande Paul Suganthan Evan Palmer Contributors Geoffrey Irving Edward Loper Manaal Faruqui Isha Arkatkar Nanxin Chen Izhak Shafran Michael Fink Alfonso Castaño Irene Giannoumis Wooyeol Kim Mikołaj Rybiński Ashwin Sreevatsa Jennifer Prendki David Soergel Adrian Goedeckemeyer Willi Gierke Mohsen Jafari Meenu Gaba Jeremy Wiesner Diana Gage Wright Yawen Wei Harsha Vashisht Yana Kulizhskaya Jay Hoover Maigo Le Lu Li Chimezie Iwuanyanwu Lu Liu Kevin Ramirez Andrey Khorlin Albert Cui Tian LIN Marin Georgiev Marcus Wu Ricardo Aguilar Keith Pallo Abhishek Chakladar Alena Repina Xihui Wu Tom van der Weide Priya Ponnapalli Caroline Kaplan Jiri Simsa Shuangfeng Li Olivier Dousse Fan Yang Jeff Piper Nathan Ie Contributors Minnie Lui Rama Pasumarthi Nathan Lintz Anitha Vijayakumar Lam Nguyen Thiet Daniel Andor Pedro Valenzuela Cosmin Paduraru Daiyi Peng Katherine Lee Shuyuan Zhang Somer Greene Duc Dung Nguyen Paula Kurylowicz Sarmishta Velury Sebastian Krause Cassidy Hardin Lucas Dixon Lili Janzer Kiam Choo Ziqiang Feng Biao Zhang Achintya Singhal Tejasi Latkar Mingyang Zhang Quoc Le Elena Allica Abellan Dayou Du Dan McKinnon Natasha Antropova Tolga Bolukbasi Orgad Keller David Reid Daniel Finchelstein Maria Abi Raad Remi Crocker Peter Hawkins Robert Dadashi Colin Gaffney Sid Lall Ken Franko Egor Filonov Anna Bulanova Rémi Leblond Vikas Yadav Shirley Chung Harry Askham Luis C. Cobo Contributors Kelvin Xu Felix Fischer Jun Xu Christina Sorokin Chris Alberti Chu-Cheng Lin Colin Evans Hao Zhou Alek Dimitriev Hannah Forbes Dylan Banarse Zora Tung Jeremiah Liu Mark Omernick Colton Bishop Chintu Kumar Rachel Sterneck Ryan Foley Rohan Jain Swaroop Mishra Jiawei Xia Taylor Bos Geoffrey Cideron Ehsan Amid Francesco Piccinno Xingyu Wang Praseem Banzal Petru Gurita Hila Noga Premal Shah Daniel J. Mankowitz Alex Polozov Nate Kushman Victoria Krakovna Sasha Brown MohammadHossein Bateni Dennis Duan Vlad Firoiu Meghana Thotakuri Tom Natan Anhad Mohananey Matthieu Geist Sidharth Mudgal Sertan Girgin Hui Li Jiayu Ye Ofir Roval Reiko Tojo Contributors Michael Kwong James Lee-Thorp Christopher Yew Quan Yuan Sumit Bagri Danila Sinopalnikov Sabela Ramos John Mellor Abhishek Sharma Aliaksei Severyn Jonathan Lai Kathy Wu Heng-Tze Cheng David Miller Nicolas Sonnerat Denis Vnukov Rory Greig Jennifer Beattie Emily Caveness Libin Bai Julian Eisenschlos Alex Korchemniy Tomy Tsai Mimi Jasarevic Weize Kong Phuong Dao Zeyu Zheng Frederick Liu Fan Yang Rui Zhu Mark Geller Tian Huey Teh Jason Sanmiya Evgeny Gladchenko Nejc Trdin Andrei Sozanschi Daniel Toyama Evan Rosen Sasan Tavakkol Linting Xue Chen Elkind Oliver Woodman John Carpenter George Papamakarios Rupert Kemp Sushant Kafle Tanya Grunina Rishika Sinha Contributors Alice Talbert Abhimanyu Goyal Diane Wu Denese Owusu-Afriyie Cosmo Du Chloe Thornton Jordi Pont-Tuset Pradyumna Narayana Jing Li Saaber Fatehi John Wieting Omar Ajmeri Benigno Uria Tao Zhu Yeongil Ko Laura Knight Amélie Héliou Ning Niu Shane Gu Chenxi Pang Dustin Tran Yeqing Li Nir Levine Ariel Stolovich Norbert Kalb Rebeca Santamaria-Fernandez Sonam Goenka Wenny Yustalim Robin Strudel Ali Elqursh Balaji Lakshminarayanan Charlie Deck Shyam Upadhyay Hyo Lee Mike Dusenberry Zonglin Li Xuezhi Wang Kyle Levin Raphael Hoffmann Dan Holtmann-Rice Olivier Bachem Summer Yue Sho Arora Eric Malmi Daniil Mirylenka Qijun Tan Christy Koh Soheil Hassas Yeganeh Contributors Siim Põder Steven Zheng Francesco Pongetti Mukarram Tariq Yanhua Sun Lucian Ionita Mojtaba Seyedhosseini Pouya Tafti Ragha Kotikalapudi Zhiyu Liu Anmol Gulati Jasmine Liu Xinyu Ye Bart Chrzaszcz Lily Wang Nikhil Sethi Tianrun Li Ben Brown Shreya Singh Wei Fan Aaron Parisi Joe Stanton Chenkai Kuang Vinod Koverkathu Christopher A. Choquette-Choo Yunjie Li TJ Lu Abe Ittycheriah Prakash Shroff Pei Sun Mani Varadarajan Sanaz Bahargam Rob Willoughby David Gaddy Ishita Dasgupta Guillaume Desjardins Marco Cornero Brona Robenek Bhavishya Mittal Ben Albrecht Ashish Shenoy Fedor Moiseev Henrik Jacobsson Alireza Ghaffarkhah Morgane Rivière Alanna Walton Clément Crepy Alicia Parrish Contributors Yuan Liu Zongwei Zhou Clement Farabet Carey Radebaugh Praveen Srinivasan Claudia van der Salm Andreas Fidjeland Salvatore Scellato Eri Latorre-Chimoto Hanna Klimczak-Plucińska David Bridson Dario de Cesare Tom Hudson Piermaria Mendolicchio Lexi Walker Alex Morris Ivo Penchev Matthew Mauger Alexey Guseynov Alison Reid Seth Odoom Lucia Loher Victor Cotruta Madhavi Yenugula Dominik Grewe Anastasia Petrushkina Tom Duerig Antonio Sanchez Steve Yadlowsky Amy Shen Amir Globerson Adam Kurzrok Lynette Webb Sahil Dua Dong Li Preethi Lahoti Surya Bhupatiraju Dan Hurt Haroon Qureshi Ananth Agarwal Tomer Shani Matan Eyal Anuj Khare Shreyas Rammohan Belle Lei Wang Chetan Tekur Mihir Sanjay Kale Jinliang Wei Contributors Ruoxin Sang Brennan Saeta Tyler Liechty Yi Sun Yao Zhao Stephan Lee Pandu Nayak Doug Fritz Manish Reddy Vuyyuru John Aslanides Nidhi Vyas Martin Wicke Xiao Ma Taylan Bilal Evgenii Eltyshev Daniel Balle Nina Martin Hardie Cate James Manyika Keyvan Amiri Yelin Kim Xi Xiong Kai Kang Florian Luisier Nilesh Tripuraneni David Madras Mandy Guo Austin Waters Oliver Wang Joshua Ainslie Jason Baldridge Han Zhang Garima Pruthi Jakob Bauer Feng Yang Riham Mansour Jason Gelman Yang Xu George Polovets Ji Liu Honglong Cai Warren Chen XiangHai Sheng Emily Xue Sherjil Ozair Adams Yu Christof Angermueller Contributors Xiaowei Li Weiren Wang Julia Wiesinger Emmanouil Koukoumidis Yuan Tian Anand Iyer Madhu Gurumurthy Mark Goldenson Parashar Shah MK Blake Hongkun Yu Anthony Urbanowicz Jennimaria Palomaki Chrisantha Fernando Kevin Brooks Ken Durden Harsh Mehta Nikola Momchev Elahe Rahimtoroghi Maria Georgaki Amit Raul Sebastian Ruder Morgan Redshaw Jinhyuk Lee Komal Jalan Dinghua Li Ginger Perng Blake Hechtman Parker Schuh Milad Nasr Mia Chen Kieran Milan Vladimir Mikulik Trevor Strohman Juliana Franco Tim Green Program Leads Demis Hassabis Koray Kavukcuoglu Overall Technical Leads (equal contribution) Jeffrey Dean Oriol Vinyals The roles are defined as below: • : Individual(s) responsible for the sub-team throughout the project. Lead Individual that had significant impact throughout the project. • Core Contributor: : Individual that had contributions to the project and was partially involved with the effort. • Contributor Responsible for the organizational aspects of the Gemini effort • Program Lead: Responsible for the technical direction of the overall Gemini effort • Overall Technical Lead: Within each role, contributions are equal, and are listed in a randomized order. Ordering within each role does not indicate ordering of the contributions. Gemini is a cross-Google effort, with members from Google DeepMind (GDM), Google Research (GR), Knowledge and Information (K&I), Core ML, Cloud, Labs, and more. We thank our reviewers and colleagues for their valuable discussions and feedback on the report— Alexandra Belias, Arielle Bier, Eleanor Tomlinson, Emily Hossellman, Gaby Pearl, Helen King, Hollie Dobson, Jaclyn Konzelmann, Jennifer Beroshi, Joel Moss, Jon Small, Jonathan Fildes, Oli Gaymond, Rebecca Bland, Reena Jana, and Tom Lue. Our work is made possible by the dedication and efforts of numerous teams at Google. We would like to acknowledge the support from Abhi Mohan, Adekunle Bello, Aishwarya Nagarajan, Alaa Saade, Alejandro Lince, Alexander Chen, Alexander Kolbasov, Alexander Schiffhauer, Amar Subramanya, Ameya Shringi, Amin Vahdat, Anda Rabatić, Anthonie Gross, Antoine Yang, Anthony Green, Anton Ruddock, Art Khurshudov, Artemis Chen, Arthur Argenson, Avinatan Hassidim, Beiye Liu, Benjamin Schroeder, Bin Ni, Brett Daw, Bryan Chiang, Burak Gokturk, Carl Crous, Carrie Grimes Bostock, Charbel Kaed, Charlotte Banks, Che Diaz, Chris Larkin, Christy Lian, Claire Cui, Clare Bycroft, Corentin Tallec, Daniel Herndon, Dave Burke, David Battle, David Engel, Dipannita Shaw, Donghyun Koo, Doug Ritchie, Dragos Stefanescu, Elissa Wolf, Emre Sargin, Eran Ofek, Eric Herren, Estella King, Fatema Alkhanaizi, Felix Gimeno, Fernando Pereira, Florent Altché, Gabriel Carvajal, Gaurav Gandhi, George Powell, Goran Pavičić, Harry Richardson, Hassan Wassel, Hongji Li, Idan Szpektor, Igor Ivanisevic, Ivan Jambrešić, Ivan Jurin, Jade Fowler, James Assiene, Jay Yagnik, Jeanbastien Grill, Jeff Seibert, Jenna LaPlante, Jessica Austin, Jianxing Lu, Jim O’Keeffe, Jin Huang, Joe Heyward, Johannes Welbl, John Jumper, Jonathan Caton, Josh Woodward, Joshua Foster, Kathryn Tunyasuvunakool, Katrina Wong, Kavya Kopparapu, Kelvin Nguyen, Kira Yin, Konstantin Sharlaimov, Kun Li, Lee Hong, Lilly Taylor, Longfei Shen, Luc Mercier, Maciej Mikuła, Mania Abdi, Manuel Sanchez, Maria Ines Aranguren, Mario Carlos Cortes III, Matthew Tait, Matthias Lochbrunner, Mehdi Ghissassi, Micah Mosley, Michael Bendersky, Michael Figurnov, Michael Harris, Michael Mathieu, Michael O’Neill, Michael Vorburger, Mihir Paradkar, Nandita Dukkipati, Nathan Carter, Nathan Watson, Neil Rabinowitz, Nikhil Dandekar, Nishant Ranka, Obaid Sarvana, Olcan Sercinoglu, Olivier Lacombe, Ottavia Bertolli, Paul Caron, Pranesh Srinivasan, Praveen Kumar, Rahul Sukthankar, Raia Hadsell, Rajagopal Ananthanarayanan, Roberto Lupi, Rosie Zou, Sachin Menezes, Sadegh Jazayeri, Sam Cheung, Sameer Bidichandani, Sania Alex, Sanjiv Kumar, Sara Wiltberger, Sarah Fitzgerald, Saz Basu, Sebastian Nowozin, Shannon Hepburn, Shayne Cardwell, Sissie Hsiao, Srinivasan Venkatachary, Sugato Basu, Sundar Pichai, Sundeep Tirumalareddy, Susannah Young, Swetha Vijayaraghavan, Tania Bedrax-Weiss, Taylor Applebaum, Teiva Harsanyi, Terry Chen, Tim Blyth, Ting Liu, Tom Cobley, Tomas Izo, Trystan Upstill, Varun Singhai, Vedrana Klarić Trupčević, Victor Cai, Vladimir Pudovkin, Vu Dang, Wenbo Zhao, Wesley Crow, Wesley Szeng, Xiaodan Song, Yazhou Zu, Ye Tian, Yicong Wang, Yixing Wang, Yossi Matias, Yunlong Jiao, Zachary Jessup, Zhenchuan Pang, Žiga Avsec, Zimeng Yang, and Zoubin Ghahramani. We’d also like to recognize the AlphaCode team, the Borg Scheduling team, the Facilities team, the Gemini Demo Team, the Global Server Ops (GSO) team, the JAX team, the the Legal team, ML SRE team, the ML Supercomputer (MLSC) team, the PartIR team, the Platforms Infrastructure Engineering (PIE) team, and the XLA Compiler team. We thank everyone at Google not explicitly mentioned above, who have shared excitement, given feedback on early Gemini models or created interesting demo uses of Gemini, and worked with or supported the core Gemini team on many aspects of this project.

Gemini -  A Family of Highly Capable Multimodal Models: Contributions and Acknowledgments

Gemini - A Family of Highly Capable Multimodal Models: Discussion and Conclusion, References

Fellow Hackers! Welcome to our monthly results announcement! For the Web3 writing contest, HackerNoon has partnered with to give monthly prizes to the best Web3 stories! Web3 Writing Contest Octopus Network How to enter the contest? Just with the . Once your story is published after our editorial review - you’ll qualify to win up to $2000 worth of OCT tokens every month from $12,000 prize pool! submit your story #Web3 tag Note: The winners must provide NEAR wallet ONLY to claim the reward money. Get NEAR wallet from . here Web3 Writing Contest June 2022 Nominations 🔥 Here’s how we selected the top 10 nominations - We picked all the stories tagged with on HackerNoon, published in June 2022. Then we chose the top stories using weightage respectively to: #Web3 60:30:10 Number of hours read Number of people reached The freshness of the content Here are the top 10 nominations: by The Future’s Tokenized (and it’s Bright!) @ghostd09 by How to Become a Web3 Developer @colina by Web3, Good Hygiene, and the Need for End to End Security @ronghuigu by 2 Exciting Ways NFTs Can Influence the Music Industry @bensoncrypto by The Ultimate Non-Fungible Tokens (NFTs) Guide: Use Cases, Ecosystem, Benefits & Challenges @sshshln by A Man Who Fell To Earth: Decentralized Software is Here to Stay @Rumyi by How to Build a Glorious Web3.0 DAO with React, Solidity, and CometChat @daltonic by Is Jack Dorsey's Web5 Idea Truly Decentralized? @adrien-book by The Solana Saga is One Story that Will Drag on for Different Reasons @metapunk by 3 Common Entry Barriers for Crypto Users in 2022 @gabrielmanga In the first place, we have “ ” by Web3, Good Hygiene, and the Need for End to End Security @ronghuigu “You may be wondering ‘why should a project need regular audits at all? Shouldn’t one cover the project in its entirety?’. This is a common (and expensive) misconception. While any good smart contract audit provide a comprehensive evaluation of a project’s underlying code, it cannot evaluate any changes or updates that occur after the audit has occurred, especially any time that a change is made to the underlying code.” should Congratulations on taking first place and winning 434 OCT Tokens!!! , @ronghuigu The second prize goes to “ ” by 2 Exciting Ways NFTs Can Influence the Music Industry @bensoncrypto “NFTs can provide viable alternatives to current systems in the music industry. Blockchain technology simplifies processes such as royalty payments and ticket sales, creating a simple and reliable process that can benefit artists, event organizers, and fans alike.” Well done ! You’ve won 260 OCT Tokens!!! @bensoncrypto The “most read” story also got the third highest percentage of votes from our editors - by has won two prizes! The Future’s Tokenized (and it’s Bright!) @ghostd09 “It’s no secret the NFT space (and crypto in general) has been battling against some major headwinds recently. What began as a boom in mostly PFP-focused NFTs last summer, has now become a competition akin to ‘survival of the fittest.’ But that’s not necessarily a bad thing, except for those projects that obviously don’t survive, but for those that do, what awaits is a blue ocean of opportunity and growth.” Congratulations, , on winning 172 Oct Tokens! @ghostd09 That’s all, hackers! See y'all next time, with more prizes and more contests coming your way! Keep an eye on for more details. We will contact the winners shortly. contests.hackernoon.com Note: The winners must provide NEAR wallet ONLY to claim the reward money. Get NEAR wallet from . here

The #Web3 Writing Contest: Round 4 Results Announced!

El concurso de escritura #Web3: ¡Resultados de la ronda 4 anunciados!

Concours d'écriture #Web3 : résultats du 4e tour annoncés !

#Web3 लेखन प्रतियोगिता: राउंड 4 के परिणाम घोषित!

#Web3 ライティング コンテスト: 第 4 ラウンドの結果が発表されました!

O Concurso de Redação #Web3: Resultados da 4ª Rodada Anunciados!

Cuộc thi Viết # Web3: Kết quả Vòng 4 được Công bố!

#Web3 写作比赛：第 4 轮结果公布！

In the past two years, the soaring price of Bitcoin has brought a wave of attention to blockchain technology. In fact, keywords such as Bitcoin, blockchain, and cryptocurrency have become academic spotlights that universities are paying attention to. In October this year, Coindesk announced the top ten universities in the United States that have opened blockchain courses. These universities are arguably the world’s top universities, including Stanford University, UC Berkeley, Harvard University, and Massachusetts Institute of Technology. Blockchain Courses Offered by Top Universities What are the characteristics of the courses offered by these schools? Which colleges are offering related courses? analyzed the top 30 North American universities from US News 2019 together with Coindesk’s list, to show you in what aspects these colleges are paying attention to blockchain technology and also the feedback from the students. SV Insight Research used keywords like “Blockchain” and “Crypto” to search the website of the universities’ curriculum. Based on the number of courses offered, Cornell University ranks first in the nation’s universities with 24 courses, followed by 17 courses at Stanford University and then 9 courses at Princeton University and UC Berkeley. For each of the top 10 universities ranked by US News 2019, at least two courses related to blockchain are offered. SV Insight Research As can be seen from the table below, major universities mainly focus on classroom courses, and there are not many universities offering online courses. But schools which do offer online courses, such as Princeton University, started these courses very early. The online course “Bitcoin and Cryptocurrency Technologies” has been in operation since 2015. From the perspective of faculties that offer courses, the Department of Computer Science or the Engineering school are the main faculties for opening these courses. For example, among the 9 courses at UC Berkeley, 8 courses are offered by the School of Engineering. Similarly, 3 of the 7 blockchain courses at Harvard University are offered by the Department of Computer Science. But there are exceptions: most of the blockchain courses taught at Stanford University are offered by the law school. At Columbia University, the University of Pennsylvania, and the Massachusetts Institute of Technology, most of the courses are offered by the business school. We can tell that STEM and finance are the two areas most focused on blockchain, while the regulation at the legal and policy levels are also closely following. This can be seen from the courses offered by law school and public policy management school. top university courses Reactions of Students and Industry What is the students’ reaction to blockchain courses? Ronghui Gu, an Assistant Professor of Computer Science at Columbia University, told that there are currently four courses at Columbia University which are directly related to blockchain, and many of the students who have come into contact have a strong interest in blockchain and technology industries. In addition to the curriculum, many top-ranking American universities have established various blockchain-related associations that are spontaneously organized by students. SV Insight Research In addition to formal courses, holding academic conferences and forming school-business cooperation has also become a new trend in the exploration of blockchain-related fields. According to Professor Ronghui Gu, Columbia University and Harvard University have held conferences on blockchains or set up blockchain module on relevant meetings’ agendas. In close cooperation with the industry, Columbia University and the IBM Center for Blockchain and Data Transparency set up two new projects targeted at students and entrepreneurs last month. Professor Gu believes that “with the full support of the Columbia-IBM Center for Blockchain and Data Transparency, blockchain business of various stages will be granted invaluable access to workshops, mentors, and business networks… the entire blockchain community is focusing on building sustainable companies for the future.” will keep track of the trends and post more updates in our official account in the future. SV Insight Research If you are interested in learning more on the research ideas and findings, you may want to check out the on Jan. 11 in San Francisco. Blockchain Connect Conference (Academic 2019) The event is emphasizing education in the blockchain space, which will gather the most authoritative blockchain professors around the world, the public chain projects with the most advanced technology, and technical experts, to discuss the most cutting-edge blockchain academic research, problems, and solutions. Professors from some of the universities that mentioned above will be presenting at the event, including Dawn Song, Professor at UC Berkeley; Elaine Shi, Associate Professor at Cornell U; Ronghui Gu, Assistant Professor at Columbia U; Raj Jain, Professor at Washington University at St. Louis, just to name a few. You may find the full list of speakers from . here

Top University Blockchain Curriculum Rankings of 2018

Despite its incredible proliferation in the past two years, the blockchain is still a relatively novel technology, requiring continual development and maturation before it can attain the prominent role that many expect it to play in the digital age. , an open sourced public blockchain initiative, is donating $400,000 to academics at the University of Columbia who are advancing blockchain research in several ways. The grant is being extended to , Columbia University’s assistant CS professor who will oversee blockchain research being conducted by post-doctorate and Ph.D. students. QTUM Ronghui Gu As it relates to its original purpose, facilitating cryptocurrency transactions, the blockchain has made incredible cultural inroads, inspiring hundreds of token projects and facilitating the global expansion of digital currencies. At the same time, as companies including IBM and Microsoft make considerable investments in the technology. enterprise adoption is accelerating Blockchain Expansion in University Laps In many ways, this growth is facilitated by the work happening at universities around the world. For example, the blockchain lab at the is one of the oldest and most prolific in the world, attracting a global cohort of blockchain developers. Other significant universities including Cornell, Duke, Georgetown, Princeton, and Stanford have each established an academic programs dedicated to blockchain technology. Massachusetts Institute of Technology Moreover, as notes, “university-led blockchain research and development initiatives are on the rise, as teams of professors, blockchain developers and students work to take the industry from market speculation to mainstream application.” Bitcoin Magazine The new program is researching , a programming language intended to bridge the gap between high-level formal reasoning and low-level systems programming in mainstream programming initiatives. DeepSEA Perhaps most importantly, this research is intended to combine gains in DeepSEA with Ethereum’s prominent smart contracts, improving the security and functionality of one of the most fundamental components of the decentralized ecosystem. As the 2016 DAO debacle demonstrates, smart contract security is mandatory for decentralized organizations to flourish. In the case of DAO, flaws in the smart contract code enabled a user steal $50 million in Ether, functionally ending one of the most ambitious and renowned crypto projects to date. Since smart contracts are written in relatively low-level code and verification methods require high-level development, DeepSEA is intended to be the innovative next step the secures smart contracts. QTUM is putting their money behind DeepSEA, believing it will make these contracts secure and enabling the decentralized economy to expand with confidence. Big Gains for Broad Adoption When it comes to mainstream blockchain adoption, smart contracts are one of the most sought after components of the technology. Functioning as a digital escrow service, smart contracts enable the automatic transfer of data, payments, or other transitory mediums, and they have obvious implications today’s digital ecosystem. QTUM’s investment in Columbia University’s research efforts is reminiscent of a broad trend in the blockchain industry. Big projects like Ripple are investing heavily in blockchain research and academics. Since the technology is so new and the number of experts are relatively scarce, investing in this research initiatives both advances blockchain’s maturity while solving problems that blockchain projects cannot fix themselves. By targeting blockchain’s usability and smart contract adoption, QTUM’s investment could return big gains for blockchain technology in general and for their platform specifically.

Columbia University to Support Smart Contract R&D

The cryptocurrency industry has never shied away from making big claims. And nor should it; blockchain technology is truly revolutionary. Decentralized cryptocurrencies and stablecoins offer an alternative to their hyperinflating local currency, an alternative that cannot be overnight. Smart contracts bring equitable agreements to the billions of people living in countries that lack fair and stable judicial systems. hundreds of millions of people seized by a bankrupt government Yet this promise of a fairer and freer world is overshadowed by the hype and scandal that has plagued the industry in recent times. As CEO of , a blockchain security firm, I have closer contact than most with the hundreds of hacks and scams that drain billions of dollars of value from Web3 every year. While there are many incredible projects out there that take security seriously and will go to any lengths necessary to protect their customers' funds while delivering a cutting-edge service, it's disappointing to see more than alone. CertiK $3.7 billion lost in 2022 And that's just the on-chain figure, it doesn't count the many billions more currently locked up in bankruptcy proceedings after the collapse of a number of major centralized crypto firms and exchanges. FTX was the major story of the latter quarter of last year. Amid all the allegations of fraud and complete lack of due diligence, the fact remains that users were ultimately unable to access the funds they had deposited when they needed them, and many livelihoods were destroyed. For an industry that prides itself on trustlessness and decentralization, this is not a good look. Crypto firms need to take a good hard look at the lessons that must be learned from FTX's collapse. It's the only way the industry as a whole will progress in the right direction and deliver on its real promise. Centralized exchanges play an important role in the broader crypto landscape. They are one of the easiest ways for users to deposit and withdraw fiat currency. They allow for the low-fee trading of thousands of assets, which is invaluable to users who may not have the capital to make trading on-chain an economical choice. Yet there remains a fundamental contradiction between and . The solution is not to abolish one in favor of the other, it's for centralized platforms to learn what they can from decentralized platforms, adopting crypto-native improvements wherever possible. centralized exchanges decentralized assets and applications This is the right thing to do for both a centralized platform's users and its business. FTX users who were burned by the exchange's lack of transparency are unlikely to trust their assets to another exchange that doesn't go above and beyond to prove to its customers that its solvent. And more FTX-like collapses will drag the industry down further. Anyone who believes in the power of blockchain technology to change the world for the better has a duty (and financial interest) to raise the level of security and transparency across the entire industry. Enter Proof of Reserves One example of a crypto-native solution that can (and should) be adopted by centralized crypto firms is Proof of Reserves. The term Proof of Reserves refers to a number of methods by which cryptocurrency exchanges and other organizations can demonstrate their solvency and show that they do actually hold the assets they claim to have in reserve. Cryptographic Proof of Reserves is a secure and user-verifiable way of proving that an exchange controls the assets they say they do. can be used to prove the existence of a set of customer deposits without revealing the actual balances or details of individual customer accounts. Merkle trees A Merkle tree is a data structure that is often used in proof of reserves to demonstrate the authenticity and integrity of a set of transactions. A Merkle tree is a tree-like structure that is created by breaking down a set of transactions (including user deposits) into smaller hash values, which are then combined and hashed again in a recursive manner. The root of the Merkle tree is the final hash value, which represents the combined hash of all the transactions in the set. This root hash can be published by the exchange, allowing users to verify that their account balance is included in the set. This form of Proof of Reserves is far superior to quarterly statements or audits that merely attest to an exchange's reserves. With cryptographic Proof of Reserves, you don't need to trust anyone, you can verify, by yourself, that your deposits have been included in the Merkle tree. One Small Step for Exchanges, One Giant Leap for Crypto The adoption of cryptographic Proof of Reserves is an easily-achievable step for exchanges that will have broad significance for the wider industry. It will be proof that we are learning the lessons that need to be learned and making the kind of fraud that impacted millions of FTX users much more difficult to conceal. It's also the sort of proactive self-regulation that sends a powerful message to the non-crypto world. Regulation is a tricky topic, but taking serious measures to protect users can only earn the industry goodwill. And who better to regulate the industry than those who understand it best and can build crypto-native tools themselves? If it's not us, that job falls to outsiders who will not view our failure to self-regulate kindly. Cryptographic Proof of Reserves does not compromise on any of the foundational ethics of crypto. In fact, it helps preserve them, by calling out those organizations that trade off the name of crypto without living up to its ideals. The adoption of cryptographic Proof of Reserves is a test for the industry, and it's one that we must pass in order to really build the future we all believe in. Lead image generated with stable diffusion.

The Proof is in the Pudding: Crypto's Existential Test

To be frank, the numbers don’t look good. of value was drained from Web3 platforms and users between July and September of this year. $504,158,033, to be precise. Over half a billion dollars This is not a great look for the crypto industry whose market capitalization has already suffered a 70% drawdown over the last year. Adding half a billion dollars of losses due to security incidents onto the industry’s notorious price volatility is not a recipe for attracting new users and bolstering the confidence of those who have stuck around. What Web3 Offers Despite these disappointing figures, it’s not all doom and gloom. As the saying goes, bear markets are the time for building. Integrating security into the pipeline of project development will ensure that Web3 not only provides real value to real people when they need it most with the least risk possible. And this wave of adoption may come sooner than many expect. This time, it’s likely to be driven by a real and pressing need for everyday people to access the services they once took for granted, rather than the desire to speculate on an emerging industry that has motivated much of the market participation in previous waves. Society is undeniably experiencing a crisis of faith in the institutions we once trusted to be looking out for our best interests. Promises written on paper were once good enough to maintain the trust that had been built over decades. But in light of these promises being ignored and broken, people are now turning to an alternative that ensures a level playing field for everyone, where there’s not even a possibility of breaking the rules thanks to certain immutable features written into the system. For example, decentralized autonomous organizations (DAOs) – though not without their growing pains – are a radical experiment in new forms of social organization and governance. Zero-knowledge proofs will allow users to take back control of their data from the companies that make billions of dollars off selling it to advertisers. This new technology has important privacy implications, too. Imagine being able to qualify for a loan without revealing your exact credit score or sensitive personal information to companies that have proven and that they cannot be trusted with securing it. time time again Currently, there are few options but to leave a trail of data across the internet, with very little insight into who has access to it and what they’re using it for. The cryptography that powers Web3 and blockchain technology offers a real alternative. So What’s Standing in the Way? But to deliver on these visionary promises, Web3 needs to . This is a nuanced issue, and there’s no one-size-fits-all solution. confront its security problem Many of the industry’s inherent strengths are also its most commonly exploited weaknesses. For example, one of the most exciting things about Web3 technology is that anyone anywhere can build and contribute to the ecosystem. This results in an immense amount of innovation that continuously propels the industry forward. But it also leads to a fundamental mismatch between those who build and those who exploit projects. When attract hundreds of millions of dollars worth of assets, they also attract some of the in the world, including state-sponsored actors. DeFi platforms built in suburban bedrooms most sophisticated hackers The FBI recently released a echoing many of the lessons that we as security auditors have learned first-hand Public Service Announcement The FBI recommends investors take the following precautions: Research DeFi platforms, protocols, and smart contracts before investing and be aware of the specific risks involved in DeFi investments. Ensure the DeFi investment platform has conducted one or more code audits performed by independent auditors. A code audit typically involves a thorough review and analysis of the platform’s underlying code to identify vulnerabilities or weaknesses in the code that could negatively impact the platform’s performance. Be alert to DeFi investment pools with extremely limited timeframes to join and rapid deployment of smart contracts, especially without the recommended code audit. Be aware of the potential risk posed by crowdsourced solutions to vulnerability identification and patching. Open-source code repositories allow unfettered access to all individuals, including those with nefarious intentions. The FBI recommends that DeFi platforms take the following precautions: Institute real-time analytics, monitoring, and rigorous testing of code in order to more quickly identify vulnerabilities and respond to indicators of suspicious activity. Develop and implement an incident response plan that includes alerting investors when smart contract exploitation, vulnerabilities, or other suspicious activity is detected. The Path Forward This is not fear-mongering, it’s a call to action. As builders in the Web3 space, we all believe this technology has real value to bring to hundreds of millions, if not billions of people around the world. Citizens of countries with underdeveloped financial infrastructure can immediately grasp the importance of decentralized technological solutions. Those with privileged access to developed markets may not have the same immediate concerns, but all it takes is the tap of a button or the stroke of a pen to suspend rights once taken for granted. The fact that Web3 exists as a real alternative to increasingly restrictive financial markets and Web 2.0 platforms should be celebrated. $500 million worth of losses in a quarter is not quite as encouraging a fact, but it’s nothing if not a ruthless trial by fire. Web3 will either perish in the flames or emerge even stronger than ever, ready to provide free and fair financial services to those who need them most. The way things are going, we might need these decentralized services sooner rather than later.

The #1 Insecurity Holding Back Web3

In the midst of the bear market and regular hacks, it seems like barely a week goes by without a headline declaring ‘crypto chaos’ and the end of web3. In the context of this market, it is more important than ever that the web3 security industry continues to hone the technologies and practices that contribute to a strong security posture. This means seeking out methods beyond the existing tools of smart contract audits and blockchain analytics, to deploy testing that further mirrors the attack vectors projects face in the wild. Audits will always be necessary to mitigate as a means of mitigating the majority of vulnerabilities through rigorous reviews and finding reports. However, there’s no escaping the fact that hackers are often one step ahead when it comes to primal knowledge of what's possible in terms of exploits after a project has launched. This is partly a problem of success. As a radically new industry with a growing multitude of technologies and functionalities, web3 is expanding the ways individuals can interact, communicate and share value online. Yet this expansion inevitably brings with it novel vulnerabilities and attack vectors that hackers will seek to exploit. We see this most clearly in the development of recent technologies such as cross-chain bridges, and of course, the infamous flash loans– all new and innovative and complex technologies that have led to large losses. Because of this, anyone claiming that their service provides the “be-all-and-end-all” of web3 security is at best naive, and at worst, has a severely limited view of the potential of web3 technology, and the possible ‘zero day’ vulnerabilities on the road to mass exploit. In short, web3 is not singular, and neither should web3 security. Instead, the methods we use to detect and prevent attacks need to be as sophisticated as the hackers, end-to-end, and as varied as the ecosystem we strive to protect. Expanding the Arsenal of Web3 Security The advent of blockchain technology presented a radically new challenge for computer scientists and developers interested in cybersecurity. Just as consensus and the decentralization principles of blockchains offered an innovative resolution to many of the longstanding security concerns associated with Web2, it also brought with it an array of new vulnerabilities and attack vectors that had to be addressed if blockchains were to achieve their potential. In today's web3 world of fast-paced, continuous integration and development, the principle and tools around end-to-end security are becoming more important. Security tools such as smart contract code audits, KYC verification of project owners and founders, and on-chain monitoring of threats - post-project launch - are now table stakes. Yet, as continue to proliferate, web3 projects must continue to seek out new and unconventional ways to protect against attack. hacks One of these methods is bug bounties, the process by which web3 projects offer rewards for so-called "ethical or white hat hackers" to find potential exploits before a malicious hacker does. This approach turns a security defense strategy on its head - fight fire with fire, man against man, not just man against machine (web3 security software). Bug bounties are increasingly being used by web3 projects as a part of their security posture, a way of crowdsourcing the collective knowledge of the web3 community to secure its ecosystem. By enlisting a collective of diverse and separate individuals, it is a process that is especially suited for a technology that places such a large store in using wide networks and decentralization as a form of protection This offers an advantage on two key fronts: Simulating Attacks Firstly, it offers the best way to simulate an attack. When launching a project and opening it up to public scrutiny, it is suddenly under the glare of potentially millions of eyes, many of whom are now incentivized (through a bounty reward) to find a way to exploit it. While end-to-end web3 security services are essential to detecting and preventing attacks, the sheer number of hackers working to find new vulnerabilities and ways to exploit them is hard to match. By opening up a project to a wide network of ethical hackers and incentivizing them to seek out attack vectors, bug bounties provide a test environment that’s as close as possible to real life. In this way, they function as a kind of vaccination for web3 projects. Just as vaccines work by simulating illnesses in the body, bug bounties work by inviting ethical hackers to try and break through a project's defenses in a controlled way, and consequently teach projects how to defend themselves in the future. Crowdsourcing Security Secondly, in addition to aiding in simulating an attack, bug bounties also crowdsource one of the most vital factors at work in both the attack and defense of web3: human ingenuity. The fact is, no matter how much technology or AI you throw at web3 security, the human element in both defense and attack is indispensable. Those of us in web3 security understand that, while a useful tool, the technologies built to secure web3 are only as good as the imagination and creativity of the humans who design and apply them. At the other end, of course, are the hackers themselves, who are able to imagine and adapt their attacks in ways that AI, or an inexperienced set of security professionals are not able to. Bug Bounties: The Next Step for Web3 Security? While bug bounties make a lot of sense as part of continuous security assessment, they have yet to be formalized as a tool within web3 security. Ultimately it is up to security vendors who offer this as part of their end-to-end security portfolio and the web3 security industry to take point on this and find the most effective way to deploy bug bounties as part of their offer. As the funds lost to exploits continue to mount, novel attack detection systems such as this cannot come soon enough.

Bug Bounties: Battling Zero Day Vulnerabilities 

CertiK released its Q2 on the 7th of July, after what by all accounts has been a devastating quarter for the web3 ecosystem. With the persistent bear market, the Luna/Terra collapse, and the failures of Three Arrows Capital and Celsius, Q2 of 2022 will certainly be remembered as a pivotal moment for web3. report In understanding the state of the web3 space, our Q2 report provides a useful lens through which we can see some of the underlying trends in web3 security. Time and again, our data shows how web3 security breaches and vulnerabilities are often the level at which the wider trends in crypto reveal themselves, and because of this, it provides vital insight into where the space is headed, and the problems it will have to resolve for it to progress. To that end, this article will spotlight three of the key takeaways from our quarterly report, and unpack their implications for the future of web3. Social Media is Becoming The “Achilles Heel” of Web3 For all the negative press around the security vulnerabilities of web3, the growing trend of phishing attacks show how, often, it is web3’s reliance on web2 technologies that is to blame rather than an inherent flaw in web3 itself. The fact is, one of the primary weaknesses of web3 technology is its overreliance on web2 infrastructures. This includes NFT marketplaces, wallets, and yes, social media platforms, all of which provide hackable points of entry into otherwise secure web3 technologies. Frustratingly, this trend is getting worse. Our data recorded 290 attacks, an increase of over 170% when compared with the 106 recorded in Q1 of 2022. That so many of these accounts targeted projects' Discord servers highlights both the dependence of NFT project’s on the platform for marketing and connecting with their audiences, but also the huge security risks that this dependence entails. What’s frustrating about these hacks from a web3 security perspective, is that the hackers are deploying the tried and tested tricks of web2 that exploit centralization and human error as a starting point, and are then using this to make lateral moves to exploit web3 in turn. This trend sheds light on the two conflicting narratives in web3. One in which blockchains are lauded as the most secure way to store and share data; and another that describes the so-called “wild west” of crypto, with vast amounts of money and assets being lost to theft or fraud every year. This data helps shed light on these two narratives by showing how, often, it is web3’s reliance on the increasingly outmoded web2 infrastructure that is responsible for web3’s bad reputation. In this we see how the future of a secure and stable web3 relies on projects repairing their fraught relationships with many of the outmoded and vulnerable infrastructures of web2. This does not necessarily mean leaving the technologies behind altogether, but instead finding a way to continue to interact with them without the vulnerabilities that they currently come with. This is important not only for the security of individual projects, but also for the wider adoption of web3 technologies as a whole. Indeed, the prevalence of phishing attacks suggests that much of web3’s negative reputation as a digital ‘wild west’ arises from the points where it relies on web2. This drives home how web3 security depends on it moving further away from, rather than returning to, the centralized practices of its predecessors. Uptick in Attacks Show How Flashloans Continue to be Sticking Point Of course, phishing attacks can not only be to blame for the concerns around web3 security. Our data also shows an increase in an attack vector that is native to web3: flashloan attacks. With a total of $308,579,156 lost as a result of flashloan attacks, Q2 saw the highest amount lost to flashloan attacks ever recorded. To put this number in perspective, this marks an over 2000% increase from the previous quarter. It is important to note that these numbers have been significantly skewed by the biggest flashloan attack on record, in which Beanstalk Farms lost $182 Million in an attack that accounts for 59% of the total amount lost across the whole quarter. However, even without the Beanstalk Farms hack, Q2 has still been a far more devastating quarter than Q1 for flashloan attacks. Indeed, taken together, these numbers show not only that flashloans are becoming more common, but that they are also potentially becoming more lucrative. Using Q1 and Q2 as baselines, we can forecast nearly $656M in losses to flashloan attacks, which is a 78% increase in loss over the previous year. Preventing this will rely on projects across the web3 ecosystem to take a more proactive approach to their security. In practice, this means deploying the full stack of web3 security tools available, from regular and thorough smart contract audits, to blockchain analytics tools that help projects stay on top of suspicious activity. Alongside this, there is also a pressing need for the web3 security industry to continue to hone and develop tools that help prevent flashloan attacks, and equip projects with the detection tools they need to stay secure. Flashloan attacks are a broad and growing category in which we see hackers continually finding new ways of leveraging flashloans to exploit vulnerabilities. Because of this, web3 security companies need to be even more adaptable than the hackers in imagining new attack vectors and detecting vulnerabilities, so that they can remedy them before they are exploited. The Numbers Don’t Lie: 2022 is Already The Most Expensive Year for Web3 Ever Our data shows how over $2 Billion has been lost in Q1 and Q2 alone, meaning that 2022 has already lost more to hacks and exploits than the entirety of 2021. This staggering figure means that 2022 is already the most expensive year for web3 by far. If these numbers continue, this year is set to see a 223% increase in the funds lost to attacks when compared with 2021. These are dire figures, yet they should serve as a rallying cry for everyone serious about the future of blockchain technology to press harder in creating a secure web3 ecosystem. On top of the vital tools of smart contract audits and blockchain analytics tools that have already been mentioned, the future of web3 security lies in the better implementation of decentralized practices both at the technological level, and at the level of team organization. Rugpulls and phishing attacks in particular often occur as a result of centralization and single-points of failure that allow both hackers and bad-faith founders to quickly make away with a project’s funds. Whilst some centralization may inevitably be required of some web3 projects, the risks can be curbed by fostering practices of decentralization around these centralized points. In practice, this includes measures such as introducing multi-sig authentication around any account with access to privileged controls, and revoking access to these accounts after each use. Furthermore, projects should foster cultures of transparency and accountability around their teams. Not only does this increase investor trust in the authenticity of a project, it also works to improve the perception of web3 as a whole. Indeed, rugpulls and exit scams have are a large part of web3’s negative reputation and, whilst rugpulls are in fact down by 42% from last quarter (likely a result of the more ‘weathered’ investors braving the bear market), they still continue to be one of the most popular forms of attack. Saving The Web3 Ecosystem Our report provides context for the storm that web3 is currently weathering. Yet, ultimately a security report can only diagnose a problem and provide advice on how to proceed; it is down to the individuals committed to the future of web3 to take the necessary steps to make the change. If there is one thing that recent events have shown, it is that the stability of individual web3 projects is inextricably linked to the stability of web3 as a whole. Because of this, securing the web3 ecosystem will always be a collective effort. No one can say for sure when the current bear market will end, but what is clear is that it will be the projects that treat their security as a priority now that put themselves in the best position to flourish when the market improves, and ensure they play an active role in achieving mass adoption.

Hack3d Unpacked: Current Trends and What They Mean for the Future of Web3

Having a smart contract audit is a lot like washing your hands– do it only once, and be prepared for the consequences. As the conversation around crypto security gets heated in response to a devastating year of losses to cybercrime – notes that “2022 is set to be the most expensive year for web3 on record”– it is vital to review some security best practices. Chief among them is the importance of thorough, and smart contract audits. CertiK’s recent report regular All too often, new blockchain projects treat their security checks as something to get out of the way before their launch, never to be thought of again. This haphazard attitude is seen clearest in projects that have only had a single smart contract audit. Projects that do this seem to think that audits are more for marketing purposes than actual security. While it is true that investors and users alike should steer clear of projects that haven’t had any kind of smart contract audit, they should also make sure that the projects they invest in are taking an active, end-to-end approach to their security. You may be wondering ‘why should a project need regular audits at all? Shouldn’t one cover the project in its entirety?’. This is a common (and expensive) misconception. While any good smart contract audit provide a comprehensive evaluation of a project’s underlying code, it cannot evaluate any changes or updates that occur after the audit has occurred, especially any time that a change is made to the underlying code. should Of course, any tech project that never updates will soon become redundant, and this is especially true in the fast-moving world of web3. Any good tech investor or user knows to avoid a project that refuses to update and develop, yet they regularly put their money in projects that never (or rarely) update their security. To return to the cleanliness metaphor, this is like shaking hands with someone after they say they haven’t washed their hands in a year. Take the as an example, which saw an attacker drain close to $16 million USD in funds. While Deus did have their smart contracts audited, an attacker was able to target a new unaudited smart contract with a sophisticated flashloan attack. Throughout the attack, the hacker was able to change the price of Deus' DEI tokens and reap the benefits of this predictable price action. They did so by manipulating a lending pool that was used by the oracle - a node of code that interprets data - that dictated the price of the token. Deus Finance exploit Now, any smart contract worth its coin would warn you of the dangers of using an oracle that determines a price by using a trading pair as these can be easily manipulated. However, since the vulnerable smart contract was outside the scope of the initial audit, auditors were not given a chance to highlight the problem. Deus should serve as a clear warning to projects that they must treat smart contract audits as an ongoing feature in their security framework and have them audited every time a significant change is made to the project. Yet, not all audits are equal. Time and again we see well-planned projects suffer from the flaws of bad auditing. Take the recent as an example. The FEG (Feed Every Gorilla) hyper-deflationary governance meme token was recently hit by two flash loan attacks which collectively drained $3.2 million USD in funds from the protocol over the course of two days. FEG exploits In each attack, the hacker (or hackers) targeted the same vulnerability in FEG’s smart contract. CertiK’s analysis of the exploit discovered that this was due to a flaw in the token’s , which directly takes user input “path” as a trusted party without any sanitation. In simple terms, this flaw allowed the hacker to repeatedly call functions that allowed them to gain unlimited allowances and drain the contract of its assets. [[Swap-To-Swap function](https://docs.fegtoken.com/fegex/smartswap#:~:text=Swap%2DTo%2DSwap%20(S2S,found%20in%20the%20next%20section) Perhaps most frustratingly for FEG, is the fact that this flaw should have been detected by a smart contract audit. Even though FEG did have their smart contracts audited, the auditors should have noticed that FEG’s untrusted “path” parameter passed to the protocol and approved for spending assets of the contract. Any good audit would then flag this as a major severity and advise the project to act and edit accordingly. There is a lesson to be learned here for the crypto-security industry– that, as hackers continue to find new and ingenious ways to exploit projects, it is no longer enough for auditors to just update their checks in response to new attacks. Instead, they must constantly be updating their technology so that when a new attack happens they are prepared for it. Both of these exploits highlight not only the need for rigorous and regular smart contract audits but also the need for a proactive, consistent, end-to-end approach to web3 security.  This amounts to a shift towards viewing security as something to be built and maintained rather than just a label to be bought and sold. This applies to the teams who need to be updating their project’s security in tandem with their technology, and also to auditing companies who need to be anticipating attacks, rather than just responding to them.

Stories, News & Mentions about GONGHUI

Gonghui’s Stories on HackerNoon

Gonghui's News & Mentions