Fueling seamless AI at scale

Silicon’s mid-life crisis AI has evolved from classical ML to deep learning to generative AI. The most recent chapter, which took AI mainstream, hinges on two phases—training and inference—that are data and energy-intensive in terms of computation, data movement, and cooling. At the same time, Moore’s Law, which determines that the number of transistors on…

Read More

Google Labs Portraits experiment features author Kim Scott

Portraits, a new experiment from Google Labs, lets you interact conversationally with AI representations of trusted experts built in partnership with the experts themselves. Our first Portrait features Kim Scott, bestselling author of “Radical Candor,” and offers AI-powered coaching inspired by her renowned communication and leadership principles. Imagine having direct access to Kim’s guidance to…

Read More

Inside the effort to tally AI’s energy appetite

AI video is on another level When we tested the energy demands of various models, we found the energy required to produce even a low-quality, five-second video to be pretty shocking: It was 42,000 times more than the amount needed for a chatbot answer a question about a recipe, and enough to power a microwave…

Read More

Effective cost optimization strategies for Amazon Bedrock

Customers are increasingly using generative AI to enhance efficiency, personalize experiences, and drive innovation across various industries. For instance, generative AI can be used to perform text summarization, facilitate personalized marketing strategies, create business-critical chat-based assistants, and so on. However, as generative AI adoption grows, associated costs can escalate in several areas including cost in…

Read More