- Google iri kugadzira "TorchTPU" kuti iite kuti machipisi ayo eAI ashande zvizere nePyTorch uye kurerutsa kutamiswa kubva kumaGPU eNvidia.
- Danho iri rine chinangwa chekushandura maTPU kuita imwe nzira inowanikwa nevanhu vakawanda mugore uye panzvimbo, zvichideredza kuvimba nehurongwa hweNvidia hweCUDA.
- Google iri kushanda pamwe chete neMeta, mutariri wePyTorch, uye iri kufunga nezvekushandisa zvikamu zvehurongwa kuti zvikurumidze kushandiswa.
- Rutsigiro rwakasimba rwePyTorch runogona kuderedza mitengo nezvipingamupinyi zvehunyanzvi kumabhizinesi anoda kusiyanisa zvivakwa zvavo zveAI.
Google iri kuchinja chinyararire chimiro chayo hurongwa mumakwikwi emakombiyuta ehungwaru hwekugadziraMushure memakore gumi nematanhatu ekushanda nemakambani ekugadzira maAI, kambani iyi yava kushandisa simba rayo guru mukuita kuti machipisi ayo eAI ashande zvakanaka nePyTorch, chishandiso cheopen-source chave chiri sarudzo yakasarudzika kune vazhinji vanogadzira maAI pasi rese.
Pakati pekuchinja uku pane chirongwa chinozivikanwa mukati mekambani se "TorchTPU", chirongwa chakagadzirirwa kuvhara musiyano uripo pakati pekuvakwa kwemidziyo yeGoogle uye kuti vatengi vanovaka sei masisitimu avo eAI. Nekuunza rutsigiro rwePyTorch kusvika padanho repamusoro paTensor Processing Units (TPUs), Google iri kutsvaga nzira yekubvisa dambudziko iri. mukana mukuru wakavakwa neNvidia kuburikidza neCUDA software ecosystem yayo.
Google inoshandura TPUs kuita makwikwi akakomba eNvidia GPUs
MaTPU eGoogle agara achitaurwa se machipisi anoshanda zvakanyanya akagadzirirwa mabasa eAI, asi hazvina kufanana nekuwanda kwemaGPU eNvidia. Chimwe chikonzero chikuru ndechekuti Nvidia yakapedza makore ichiita kuti PyTorch ishande zvakanaka pahardware yayo, ukuwo Google ichinyanya kutarisa pazvishandiso zvayo uye mashandiro emukati.
Mukati meAlfabheti, maTPU ave injini yekukura yakakosha yeGoogle CloudKutengesa mukana wekuwana machipisi aya kuburikidza nepuratifomu yayo ye "cloud" ikozvino kwave chikamu chikuru chechinangwa cheGoogle chekuratidza kune vanoisa mari kuti mari yavo yeAI inogona kushandura kuita mari inobatika, kwete kungotsvaga mukurumbira kana zvigadzirwa zvekuyedza.
Zvisinei, hardware chete haikundi vagadziri. Makambani ari kutarisa TPUs akaudza Google kakawanda kuti kuenderana kwesoftware kwave kuri chinhu chinonetsa: zvikwata zvakagara zvichinyatsoenderana nePyTorch hazvidi kugadzira patsva kodhi yazvo kana kudzidzisa vashandi kuti vaedze chip itsva.
Ndipo panopinda TorchTPU. Chirongwa ichi chakagadzirirwa kuita kuti TPU dzinzwe, kubva pamaonero emugadziri, Zviri nyore kushandisa nePyTorch sezvakaita maNvidia GPU nhasi.Chinangwa ndechekuti mamodheru nemapaipi ePyTorch aripo anogona kutamiswa pasina shanduko diki, saka mutengo nenjodzi yekuedza maTPU zvinodzikira zvakanyanya.
Mutauriri weGoogle Cloud akadzivisa kupinda mune zvehunyanzvi, asi akasimbisa kuti chinangwa chikuru ndechekupa vatengi kuchinjika kukuru mukuita kwavo mabasa eAI, zvisinei nekuti vanosarudza hardware ipi pasi payo.
Zvinonyatsochinja TorchTPU kune vanogadzira PyTorch
PyTorch, yakagadzirwa uye yakasimudzirwa neMeta, yave iyo de facto standard framework yekuvaka yemazuva ano AI masisitimuMainjiniya mazhinji muSilicon Valley nekune dzimwe nzvimbo haasi ma kernels ekunyora nemaoko eNvidia, AMD kana Google chips; pachinzvimbo, vanovimba nePyTorch nema framework akafanana anopa zvikamu zvezvikamu zvakagadzirwa kare uye zvishandiso zvekudzidzisa.
Kubva payakaburitswa muna 2016, kukura kwePyTorch kwakabatana zvakanyanya ne CUDA nemaraibhurari ayo akaipoteredza, software yakawanda iyo vazhinji vanoongorora Wall Street vanoona sepfuma inonyanya kukosha yeNvidia. Mainjiniya eNvidia vakaisa mari yakawanda kuti vave nechokwadi chekuti PyTorch inoshanda nemaGPU avo zvakanaka, zvichiita kuti kusanganisa kuve sarudzo yekutanga yekudzidzisa nekushandisa maAI mamodheru makuru.
Kusiyana neizvi, Google yakapedza makore ichitsigira Jax, imwe software framework yaifarirwa kunyanya mukati memapoka ayo ekutsvagisa nezvigadzirwa. MaTPU aivimba nechikamu che compiler chinonzi XLA kuti ishandise kodhi yakavakirwa paJax zvinobudirira, uye zvakawanda zveGoogle zvemukati meAI software stack uye performance optimizations zvakavakirwa pamubatanidzwa iwoyo.
Mhedzisiro yacho ndeyekuti kwave nekusawirirana kuri kukura pakati mashandisiro anoita Google pachayo machipisi ayo uye kuti vatengi vazhinji vekunze vanosarudza kushanda sei. Makambani mazhinji ane maitiro akafanana paPyTorch, zvinoreva kuti kutamira kuTPU kunowanzoreva kuchinja kwakasiyana muhunyanzvi hwekushandisa, kodhi uye kugadzira maturusi.
NeTorchTPU, Google iri kuedza kubvisa kukanganiswa ikoko. Chinangwa chepurojekiti iyi ndechekuunza rutsigiro rwakazara rwePyTorch paTPUs, saka makambani anogona kuramba achivimba nemaraibhurari anozivikanwa, marongero ekudzidzisa uye maitiro ekuparadzira uku achichinja chinangwa chehardware chiripo chete. Izvi zvinogona kuderedza zvakanyanya kushanda kweinjiniya uye nzira yekudzidza yezvikwata zvinoda kuongorora mashandiro eTPU kana zvakanakira mutengo.
Zvimwe zviwanikwa, nzvimbo yakavhurika uye kuzvipira kwakadzama
Sekureva kwevanhu vanoziva nezvechirongwa ichi, TorchTPU haisi imwe nzira yekuyedza. Kusiyana nedzimwe nzira dzakamboshandiswa dzekuita kuti PyTorch ishande paTPU, Google ikozvino yapa vanhu basa iri. kutarisirwa kwakawanda kwesangano, bhajeti uye kukosha kwehurongwa kune izvi, vachizvitora senzvimbo huru yehurongwa hwayo hweAI pane kuti ive chirongwa chekuenderana nezvinodiwa nevamwe.
Chimwe chezvinhu zvinonyanya kukosha chiri kufungwa nezvacho ndeche zvikamu zve software stack zvinovhura-vhura shure kweTorchTPU. Nekuburitsa zvinhu zvakakosha kunharaunda, Google inotarisira kukurumidzisa kushandiswa, kukwezva vanopa rubatsiro vekunze uye kuvaka kuvimbana pakati pevatengi vakuru vanoda pachena uye kugadzikana kwenguva refu mumapuratifomu avo eAI.
Mafungiro aya akavhurika akagadzirirwawo kusimbisa makambani akaona rutsigiro rweTPU serwakabatana zvakanyanya nenzira yemukati yeGoogle yekuita zvinhu. Kupa vagadziri vekunze mukana wekuongorora, kuwedzera uye kugadzirisa zvinhu zvinogona kuitwa neTorchTPU. MaTPU haanzwi sechitsuwa chine vanhuwo zvavo uye kufanana nemugari wepamusoro-soro mune ecosystem yakakura yePyTorch.
Kumakambani, izvi zvinokosha nenzira dzinoshanda. Kana TorchTPU ikabudirira, zvinogona zvikuru deredza mutengo wekutamisa kubva kuNvidia GPUs kuenda kuGoogle TPUs, zvichiita kuti zvive nyore kusiyanisa zvivakwa zvemakombiyuta pasina kutanga kunyora patsva software kwemakore akawanda.
Vatengi vakaudza Google kakawanda kuti chinodiwa chekare chekuchinja kuenda kuJax chaive chinhu chikuru chinovadzivisa. PyTorch yatove kutonga pakati pevagadziri veAI, uye mumisika iri kufamba nekukurumidza, masangano mashoma anoda kumbomira kugadzira zvigadzirwa zvavo. gadzirisa patsva hurongwa hutsva kungoshandisa hardware yakasiyana.
Kubva pamidziyo yemukati kusvika kune zvinopihwa nebhizinesi rakakura
Kwenguva yakareba, Alphabet yakachengetedza huwandu hwakawanda hweTPU yayo kushandiswa kwemukati mukati meGoogle, kupa simba kutsvaga, kushandura, masisitimu ekurumbidza uye tsvakiridzo yekutanga yeAI. Maonero iwayo akatanga kuchinja muna 2022, apo chikamu che cloud computing chakapihwa simba guru pamusoro pekuti TPU dzaigadzirwa sei uye dzaitengeswa sei.
Kubva ipapo, kuwanikwa kweTPU kuburikidza Google Cloud yakawedzera zvakanyanyaSezvo kufarira kwemabhizinesi muAI kuri kuwedzera, Google yakaisa machipisi ayo senzira yekuti vatengi vashandise macomputer emhando yepamusoro vasina kufanira kutarisira maGPU clusters avo akabatana zvakanyanya.
Munguva pfupi yapfuura, Google yakawedzera kufambira mberi kutengesa maTPU zvakananga kuti ashandiswe munzvimbo dzedata dzevatengi vavo, kwete chete kuburikidza negore rayo revanhu vose. Kuchinja ikoko kunobvumira masangano makuru ane zvinodiwa zvakasimba zvemitemo kana kuti kunonoka kubatanidza maTPU muzvivakwa zvavo panzvimbo iyi uku vachiri kubatsirwa nehurongwa hweGoogle hwehardware.
Kuwedzera uku kunochinjawo zvinokosheswa neGoogle mukati. Kambani iyi inoda TPU kuti ikwanise kuita zvese zviri zviviri. inomhanya zvigadzirwa zvayo zveAI—kubva paGemini chatbot kusvika kumabasa ekutsvaga anoshandiswa neAI — uye kushandira vatengi vekunze veGoogle Cloud, kusanganisira makambani ane mukurumbira eAI akadai seAnthropic anovimba neTPU yekurenda.
Kuti izvi zvose zvienderane, Google yakasimudzira hutungamiriri hweAI infrastructure: mukuru wekare Amin Vahdat akagadzwa kuva mukuru weAI infrastructure uye iye zvino ari kushanda zvakananga kuna CEO Sundar PichaiMutsetse wemishumo uyu unoratidza kuti hardware nesoftware zvave zvakakosha sei pazvinangwa zveGoogle zveAI.
Kushanda pamwe chete neMeta kusimbisa PyTorch paTPUs
Google haisi kutevera TorchTPU yoga. Sekureva kwevanhu vane ruzivo nezvehurukuro idzi, kambani iri kushanda pamwe chete ne Meta, mugadziri uye mutariri wePyTorch, kukurumidzisa rutsigiro rweTPU uye kuenderana nemirairo yehunyanzvi inobatsira vese vari vaviri.
Hurukuro pakati pemakambani dzinosanganisira zvirongwa zvingapa Meta mukana wekuwana TPU yakawanda. Zvakarongwa kare zvinonzi zvakataura izvi semabasa anotarisirwa: Google yaizoisa machipisi ayo munzvimbo dzaigona kushandisa Meta software yayo nemamodheru, Google ichitarisira zvakawanda zvekushanda.
Kune Meta, kuita kuti PyTorch ishande zvakanaka mumhando dzakasiyana dzehardware kwakakosha zvikuru. Kambani iyi ine chikonzero chakajeka chekuti kuderedza mari yekufungidzira uye kusiyanisa kubva pakuvimba chete neNvidia GPUs, zvese kuderedza mari yaro uye kusimbisa nzvimbo yaro yekutaurirana pakutaurirana kutenga machipisi mune ramangwana.
Nekushanda pamwe chete neGoogle, Meta inogona kubatsira kuona kuti PyTorch inoramba iripo hardware isingazivikanwe uye yakagadziriswa zvakanyanya, pachinzvimbo chekuonekwa sechinobatanidzwa zvakasimba kune ecosystem yemutengesi mumwe chete. Izvozvo, zvinosimbisa chinzvimbo chePyTorch sechiyero chenharaunda uye zvinochengetedza hurongwa hwacho huchikwezva vaongorori nemabhizinesi zvakafanana.
Meta kusvika pari zvino yakaramba kutaura pachena nezvezvirongwa izvi, asi kurongeka kwezvido kwakajeka: iyo social media neAI hofori inoda sarudzo dzinopfuura Nvidia, nepo Google ichida kuti PyTorch inzwe seyakajairika paTPU dzayo kuitira kuti vatengi vakawanda vade kudziedza.
Kubvisa mukana weCUDA weNvidia
Kutonga kweNvidia muAI hakusi kungotumira maGPU ane simba chete. Kwemakore mazhinji, kambani iyi yakagadzira software stack yakakura—yakavakirwa—yakabatanidzwa zvakanyanya mumaframework akaita sePyTorch. Kusanganiswa uku kwehardware nesoftware kwave chikuva chekudzidzisa nekufungidzira chemhando dzepamusoro dzeAI.
Nekuda kwekubatana ikoko kwakasimba, masangano mazhinji anoona Kutama kubva kuNvidia sezvinhu zvine njodzi uye zvinodhuraMakodhesi, mashandiro ebasa uye hunyanzvi hwevashandi zvese zvakagadziridzwa kuti zvienderane neCUDA, zvichiita kuti mamwe machipisi aite seanogona kukonzera kusawirirana kunyangwe achivimbisa mitengo iri nani kana kushanda zvakanaka papepa.
Kuedza kwaGoogle kushandisa TorchTPU kuedza kubvisa mukana iwoyo. Kana PyTorch ikakwanisa kushandisa TPUs nenzira iri nyore uye kugadzirisa mashandiro akafanana neaya ari paNvidia GPUs, mabhizinesi anowana mukana. imwe nzira inovimbika yemabasa makuru eAIMumusika umo kudiwa kweAI computing kuri kuwedzera uye zvipingamupinyi zvekupa zvinhu zvakajairika, kuva neimwe sarudzo yakakura kunogona kukwezva zvikuru.
Panguva imwe chete, sarudzo yeGoogle yekufunga nezve open-sourcing key pieces dzeTorchTPU stack inoratidza nzira yakasiyana neyeNvidia yakabatanidzwa zvakanyanya. Nekugovana zvimwe zve software iri pasi, Google ine chinangwa che kuvaka chivimbo pakati pevagadziri vanokoshesa kujeka uye kutakura zvinhu.
Hapana chimwe chezvizvi chinovimbisa kuti maTPU achatsiva maGPU, asi zvinochinja calculus. Pane kusarudza pakati pemamiriro ezvinhu eNvidia akura uye imwe nzira inoda kufambiswa kwezvishandiso zvizere, vatengi vanogona kufunga nezveizvi. mashandiro, mutengo uye kuwanikwa uku uchigara munzvimbo yakajairika yePyTorch.
Kuburikidza nekushandiswa kwemabasa mugore rose uye panzvimbo dzakasiyana-siyana, shanduko iyoyo inogona kuita kuti zvive nyore kumasangano vanopa zvishandiso zvekubatanidza uye kuenzanisa nekufamba kwenguva, pane kuvharira ma "AI roadmaps" avo kumutengesi mumwe chete nekutadza.
Sezvo Google ichisimbisa kuzvipira kwayo kuPyTorch kuburikidza neTorchTPU, inowedzera mukana webhizinesi kuwana maTPU uye inosimbisa kushanda pamwe chete neMeta, iyo mamiriro ekukwikwidzana akapoteredza zvivakwa zveAI Kutungamira kweNvidia, kwakavakirwa pamakore ekushanda kwehardware nekubatanidzwa kweCUDA, kuchiri kukosha, asi vatengi ikozvino vanoona nzira dzechokwadi dzekuchinja-chinja mabasa avo eAI uye kuti vanobhadhara marii pakombuta iri pasi.
