Wednesday, November 29, 2023
HomeBusiness NewsStartupsWhen it comes to large language models, should you build or buy?...

When it comes to large language models, should you build or buy? • TechCrunch


Last summer could only be described as an “AI summer,” especially with large language models making an explosive entrance. We saw huge neural networks trained on a massive corpora of data that can accomplish exceedingly impressive tasks, none more famous than OpenAI’s GPT-3 and its newer, hyped offspring, ChatGPT.

Companies of all shapes and sizes across industries are rushing to figure out how to incorporate and extract value from this new technology. But OpenAI’s business model has been no less transformative than its contributions to natural language processing. Unlike almost every previous release of a flagship model, this one does not come with open-source pretrained weights — that is, machine learning teams cannot simply download the models and fine-tune them for their own use cases.

Instead, they must either pay to use them as-is, or pay to fine-tune the models and then pay four times the as-is usage rate to employ it. Of course, companies can still choose other peer open-sourced models.

This has given rise to an age-old corporate — but entirely new to ML — question: Would it be better to buy or build this technology?

It’s important to note that there is no one-size-fits-all answer to this question; I’m not trying to provide a catch-all answer. I mean to highlight pros and cons of both routes and offer a framework that might help companies evaluate what works for them while also providing some middle paths that attempt to include components of both worlds.

See also  AI-generated spam is on its way to your inbox – and its secret weapon will be personalisation

Buying: Fast, but with clear pitfalls

While building looks attractive in the long run, it requires leadership with a strong appetite for risk, as well as deep coffers to back said appetite.

Let’s start with buying. There are a whole host of model-as-a-service providers that offer custom models as APIs, charging per request. This approach is fast, reliable and requires little to no upfront capital expenditure. Effectively, this approach de-risks machine learning projects, especially for companies entering the domain, and requires limited in-house expertise beyond software engineers.

Projects can be kicked off without requiring experienced machine learning personnel, and the model outcomes can be reasonably predictable, given that the ML component is being purchased with a set of guarantees around the output.

Unfortunately, this approach comes with very clear pitfalls, primary among which is limited product defensibility. If you’re buying a model anyone can purchase and integrate it into your systems, it’s not too far-fetched to assume your competitors can achieve product parity just as quickly and reliably. That will be true unless you can create an upstream moat through non-replicable data-gathering techniques or a downstream moat through integrations.

What’s more, for high-throughput solutions, this approach can prove exceedingly expensive at scale. For context, OpenAI’s DaVinci costs $0.02 per thousand tokens. Conservatively assuming 250 tokens per request and similar-sized responses, you’re paying $0.01 per request. For a product with 100,000 requests per day, you’d pay more than $300,000 a year. Obviously, text-heavy applications (attempting to generate an article or engage in chat) would lead to even higher costs.

See also  Soccer Training Aren't As Bad As You Think Here's Why

You must also account for the limited flexibility tied to this approach: You either use models as-is or pay significantly more to fine-tune them. It is worth remembering that the latter approach would involve an unspoken “lock-in” period with the provider, as fine-tuned models will be held in their digital custody, not yours.

Building: Flexible and defensible, but expensive and risky

On the other hand, building your own tech allows you to circumvent some of these challenges.


Source link

James Thomas
James Thomas
Hello, I am James Thomas blogger and content creator who specializes in personal finance and investing at Business Advise. I have been writing for over 5 years and have built a large following of readers who value practical advice and actionable tips. I'm committed to helping people take control of their financial futures and achieve their goals.

Most Popular

asia788dewata88Asia788 Maxwinasia788asia788DEWATA88dewata88linetogeltogelupprotogeltogelonjon4dbri4dwinstar4dneon4dangsa4ddesa4dklik4dcici4dkuy4dbni4dkenangan4doyo4dmiya4dasia788asia788kita99dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88key4ddragon4dpalu4dzara4dollo4dvisa4ddipo4dbingo4dambon4drasa4dwasiat4dneng4dpragmatic4dmenara4dgaruda4ddaya4dtata4daksara4dprada4dkingdom4droma4ddangdut4dtarget4darta4dvava4dyes4dtag4dloyal4dpola4dbajaj4dsisil4dpermen4dsenopati4dpapua4dpascol4dvenus4deropa4dkuat4dpedia4dks4dkekar4dlampung4dacong4dfantastic4dsega4doplet4dsuara4dpaitohk4dangkanet4dbetwin4datm4dlebah4dlima4dlipat4dibu4dtoto4dbarong4datas4diron4dbandit4dsemangat4dhut4dkoibet4dkebaya4daha4dmentos4dyolo4deak4dkelas4dtotal4dmamen4dvia4dhigh4djanda4ddewata88gacor7777asia788virgoBotuna4DBotuna4Dasia788asia788kita99kita99kita99asia788kita99Botuna4Dkita99kita99spaceman Virgobet88VIRGOBET88LOTRE4DASIA788ziptogelkita99virgobet88kita99kita99murah4dbukti4ddhx4dtante4dsbclive4dcalon4dmaya4dmedan4dstadium4dsekar4dtunas4dkumbang4dto4dtebar4dbocah4dneko4daxiata4dbibit4dkebaya 4doplet4dtoto 4dmaria togelbentengtogeltogel ccpt togelasiatogel88master togeldultogelindotogelzia togelspace togeldota togelkepri togeljeboltogeldagotogelpartaitogelpintu togeltoto88bola88kaisar888idcash88usaha188matahari88royal188garuda888mega288grandbet88prada188cocol88taktik88ovo88playbook88indolottery88tambang888lumbung88wayang88ugbet88oyo88gelora188ligaplay88sarang188probet88davo88mevius88gacor88nusantara88area188untung88v88totoorion88shio88subur88cipit88jago88soju88masterslot88dota88menangbet88pandora188megaslot88ajudan88sikat88situstogel88happybet188betwin188glowin88topslot88betslot88lineslot88olb88juragan88jingga88cukong88dewagame88visa288beton888ingatbola88liga788berlian888qq88asia988betdoremi88nona88bejo88spinhoki88cuan88kingbet188rajatoto88fixbet88suhu88mainslot88wslot888bintangbet88bintang88halo88planet88jpslot88gading88poka88arya88batara88bso88petir388autospin88ole388ciputra88tektok77kita99kita99kita99kita99kita99kita99kita99kita99kita99kita99kita99kita99tektok77virgobet88kita99virgobet88dewataslot88dewata888dewa888wukong138wukong138dewaslot88wukong138balislotkapalslotKAPALSLOTkapalslotkapalslottigerslot4dVirgobet88pohon4dpohon4dpohon4dpohon4dAsia788Asia788Asia788kikislotkikislotkikislotkikislotSLOTUP88slotup88slotup88slotup88asia788bigo4ddewata88bigo4dbigo4dbigo4dasia788asia788dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88dewata88danaslot77game slot maxwinjudi online slot gacor