Language-based AI model spots early heart disease in ECGs, reaching 94.2% accuracy

A machine-learning model based on Transformer architecture, a form of artificial intelligence originally developed for ...
VentureBeat

New transformer architecture can make language models faster and resource-efficient

Large language models like ChatGPT and Llama-2 are notorious for their extensive memory and computational demands, making them costly to run. Trimming even a small fraction of their size can lead to ...

Researchers say they trained a foundation model from scratch for about $1,500

Sapient researchers trained a 1B reasoning model on just 40B tokens — scoring competitively with 2B-7B models at a fraction ...
ZDNet

Microsoft and Nvidia create 105-layer, 530 billion parameter language model that needs 280 A100 GPUs, but it's still biased

Nvidia and Microsoft have teamed up to create the Megatron-Turing Natural Language Generation model, which the duo claims is the "most powerful monolithic transformer language model trained to date".
Android Police

Transformers: Everything you need to know about the deep learning model

I’ve been covering Android since 2023, when I joined Android Police, mostly focusing on AI and everything around Pixel and Galaxy phones. I’ve got a bachelor’s in IT with a major in AI, so I naturally ...

Predictive text in 'demonstrable decline' with introduction of AI-based language models

If internet chatter is to be believed, the intuitiveness and efficiency of predictive text and autocorrect have fallen off a ...