11 Myths About Generative AI

What you’ll learn: Lauro Rizzatti has turned his vast understanding of the semiconductor and verification markets to generative AI to better understand its benefits and limitations, something long overdue as myths and misconceptions multiply across the internet. Below he debunks 11 of those myths surrounding the technology. 1. Any computing engine, whether CPUs, GPUs, FPGAs, … Read more

Why Software Is Eating The Hardware

Software is eating the world today while hardware is feeding it and data is driving it. In 2024, software will be eating the hardware as AI and Generative AI take more and more compute power to execute. GenAI also needs substantial data communication throughput delivered by the underlying hardware infrastructure. These demanding requirements are necessary … Read more

Parsing the Mindboggling Cost of Ownership of Generative AI

The latest algorithms, such as GPT-4, pose a challenge to the current state-of-the-art processing hardware, and GenAI accelerators aren’t keeping up. In fact, no hardware on the market today can run the full GPT-4. Current large language model (LLM) development focuses on creating smaller but more specialized LLMs that can run on existing hardware is a diversion. … Read more

Long-standing Roadblock to Viable L4L5 Autonomous Driving and Generative AI Inference at the Edge

Two recent software-based algorithmic technologies –– autonomous driving (ADAS/AD) and generative AI (GenAI) –– are keeping the semiconductor engineering community up at night. While ADAS at Level 2 and Level 3 are on track, AD at Levels 4 and 5 are far from reality, causing a drop in venture capital enthusiasm and money. Today, GenAI … Read more

System Challenges of Generative AI Inference Acceleration

When you look under the hood of generative AI processing, the system design challenges are many. Learn how efficiency, power consumption, and memory issues all come into play. In less than a year, generative AI saw global fame and use through OpenAI’s ChatGPT, a popular algorithm based on transformers. Transformer-based algorithms can learn complex interactions … Read more

Generative AI and memory wall: A wakeup call for IC industry

Judged by the presence of artificial intelligence (AI) and machine learning (ML) technologies at 2023 Design Automation Conference (DAC), the premiere event for semiconductor designers, computing hardware for accelerating AI/ML software workloads is finally receiving due attention. According to PitchBook Data, in the first six months of 2023, more than 100 startups designing novel AI/ML … Read more

The Promise and Reality of Generative AI

Mass adoption of generative AI hinges on improving processing efficiency and lowering total cost of ownership. Similar to the internet and the invention of its World Wide Web application, generative AI has seized the public’s imagination. ChatGPT, the most popular AI chatbot launched a mere eight months ago, caught the world by surprise, reported to … Read more

An Epic Chiplet Evolution

Jean-Marie Brunet, Vice President and General Manager of the Siemens Hardware-Assisted Verification business unit finds himself and his group in a unique situation when it comes to the topic of chiplets.