AI for Computer Architecture

AI for Computer Architecture PDF

Author: Lizhong Chen

Publisher: Springer Nature

Published: 2022-05-31

Total Pages: 124

ISBN-13: 3031017706

DOWNLOAD EBOOK →

Artificial intelligence has already enabled pivotal advances in diverse fields, yet its impact on computer architecture has only just begun. In particular, recent work has explored broader application to the design, optimization, and simulation of computer architecture. Notably, machine-learning-based strategies often surpass prior state-of-the-art analytical, heuristic, and human-expert approaches. This book reviews the application of machine learning in system-wide simulation and run-time optimization, and in many individual components such as caches/memories, branch predictors, networks-on-chip, and GPUs. The book further analyzes current practice to highlight useful design strategies and identify areas for future work, based on optimized implementation strategies, opportune extensions to existing work, and ambitious long term possibilities. Taken together, these strategies and techniques present a promising future for increasingly automated computer architecture designs.

Ascend AI Processor Architecture and Programming

Ascend AI Processor Architecture and Programming PDF

Author: Xiaoyao Liang

Publisher: Elsevier

Published: 2020-07-29

Total Pages: 310

ISBN-13: 012823489X

DOWNLOAD EBOOK →

Ascend AI Processor Architecture and Programming: Principles and Applications of CANN offers in-depth AI applications using Huawei’s Ascend chip, presenting and analyzing the unique performance and attributes of this processor. The title introduces the fundamental theory of AI, the software and hardware architecture of the Ascend AI processor, related tools and programming technology, and typical application cases. It demonstrates internal software and hardware design principles, system tools and programming techniques for the processor, laying out the elements of AI programming technology needed by researchers developing AI applications. Chapters cover the theoretical fundamentals of AI and deep learning, the state of the industry, including the current state of Neural Network Processors, deep learning frameworks, and a deep learning compilation framework, the hardware architecture of the Ascend AI processor, programming methods and practices for developing the processor, and finally, detailed case studies on data and algorithms for AI. Presents the performance and attributes of the Huawei Ascend AI processor Describes the software and hardware architecture of the Ascend processor Lays out the elements of AI theory, processor architecture, and AI applications Provides detailed case studies on data and algorithms for AI Offers insights into processor architecture and programming to spark new AI applications

Artificial Intelligence and Architecture

Artificial Intelligence and Architecture PDF

Author: Stanislas Chaillou

Publisher: Birkhäuser

Published: 2022-03-07

Total Pages: 208

ISBN-13: 3035624046

DOWNLOAD EBOOK →

Künstliche Intelligenz (KI) hat Eingang in unzählige Branchen gefunden. In der Architektur steckt der Einsatz von KI noch in den Kinderschuhen, doch die Entwicklung der letzten Jahre hat vielversprechende Ergebnisse gebracht. Das Buch ist eine gut verständliche Einführung. Sie bietet einen Überblick über die Geschichte der KI und ihre ersten Anwendungen in der Architektur. Im zweiten Teil präsentiert der Autor konkrete Beispiele für den kreativen Einsatz von KI in der Praxis. Führende Experten, von der Havard-University bis zur Bauhaus Universität, eröffnen schließlich in Essays vielfältige Perspektiven auf das Potenzial von KI. Als Einführung zeigt das Buch ein Panorama dieser neuen technologischen Möglichkeiten und verdeutlicht so das Versprechen, das sie für die Architektur darstellen.

Processing-in-Memory for AI

Processing-in-Memory for AI PDF

Author: Joo-Young Kim

Publisher: Springer Nature

Published: 2022-07-09

Total Pages: 168

ISBN-13: 3030987817

DOWNLOAD EBOOK →

This book provides a comprehensive introduction to processing-in-memory (PIM) technology, from its architectures to circuits implementations on multiple memory types and describes how it can be a viable computer architecture in the era of AI and big data. The authors summarize the challenges of AI hardware systems, processing-in-memory (PIM) constraints and approaches to derive system-level requirements for a practical and feasible PIM solution. The presentation focuses on feasible PIM solutions that can be implemented and used in real systems, including architectures, circuits, and implementation cases for each major memory type (SRAM, DRAM, and ReRAM).

Artificial Intelligence Hardware Design

Artificial Intelligence Hardware Design PDF

Author: Albert Chun-Chen Liu

Publisher: John Wiley & Sons

Published: 2021-08-23

Total Pages: 244

ISBN-13: 1119810477

DOWNLOAD EBOOK →

ARTIFICIAL INTELLIGENCE HARDWARE DESIGN Learn foundational and advanced topics in Neural Processing Unit design with real-world examples from leading voices in the field In Artificial Intelligence Hardware Design: Challenges and Solutions, distinguished researchers and authors Drs. Albert Chun Chen Liu and Oscar Ming Kin Law deliver a rigorous and practical treatment of the design applications of specific circuits and systems for accelerating neural network processing. Beginning with a discussion and explanation of neural networks and their developmental history, the book goes on to describe parallel architectures, streaming graphs for massive parallel computation, and convolution optimization. The authors offer readers an illustration of in-memory computation through Georgia Tech’s Neurocube and Stanford’s Tetris accelerator using the Hybrid Memory Cube, as well as near-memory architecture through the embedded eDRAM of the Institute of Computing Technology, the Chinese Academy of Science, and other institutions. Readers will also find a discussion of 3D neural processing techniques to support multiple layer neural networks, as well as information like: A thorough introduction to neural networks and neural network development history, as well as Convolutional Neural Network (CNN) models Explorations of various parallel architectures, including the Intel CPU, Nvidia GPU, Google TPU, and Microsoft NPU, emphasizing hardware and software integration for performance improvement Discussions of streaming graph for massive parallel computation with the Blaize GSP and Graphcore IPU An examination of how to optimize convolution with UCLA Deep Convolutional Neural Network accelerator filter decomposition Perfect for hardware and software engineers and firmware developers, Artificial Intelligence Hardware Design is an indispensable resource for anyone working with Neural Processing Units in either a hardware or software capacity.

Architecture in the Age of Artificial Intelligence

Architecture in the Age of Artificial Intelligence PDF

Author: Neil Leach

Publisher: Bloomsbury Publishing

Published: 2021-11-18

Total Pages: 281

ISBN-13: 1350165549

DOWNLOAD EBOOK →

Artificial intelligence is everywhere – from the apps on our phones to the algorithms of search engines. Without us noticing, the AI revolution has arrived. But what does this mean for the world of design? The first volume in a two-book series, Architecture in the Age of Artificial Intelligence introduces AI for designers and considers its positive potential for the future of architecture and design. Explaining what AI is and how it works, the book examines how different manifestations of AI will impact the discipline and profession of architecture. Highlighting current case-studies as well as near-future applications, it shows how AI is already being used as a powerful design tool, and how AI-driven information systems will soon transform the design of buildings and cities. Far-sighted, provocative and challenging, yet rooted in careful research and cautious speculation, this book, written by architect and theorist Neil Leach, is a must-read for all architects and designers – including students of architecture and all design professionals interested in keeping their practice at the cutting edge of technology.

Deep Learning for Computer Architects

Deep Learning for Computer Architects PDF

Author: Brandon Reagen

Publisher: Springer Nature

Published: 2022-05-31

Total Pages: 109

ISBN-13: 3031017560

DOWNLOAD EBOOK →

Machine learning, and specifically deep learning, has been hugely disruptive in many fields of computer science. The success of deep learning techniques in solving notoriously difficult classification and regression problems has resulted in their rapid adoption in solving real-world problems. The emergence of deep learning is widely attributed to a virtuous cycle whereby fundamental advancements in training deeper models were enabled by the availability of massive datasets and high-performance computer hardware. This text serves as a primer for computer architects in a new and rapidly evolving field. We review how machine learning has evolved since its inception in the 1960s and track the key developments leading up to the emergence of the powerful deep learning techniques that emerged in the last decade. Next we review representative workloads, including the most commonly used datasets and seminal networks across a variety of domains. In addition to discussing the workloads themselves, we also detail the most popular deep learning tools and show how aspiring practitioners can use the tools with the workloads to characterize and optimize DNNs. The remainder of the book is dedicated to the design and optimization of hardware and architectures for machine learning. As high-performance hardware was so instrumental in the success of machine learning becoming a practical solution, this chapter recounts a variety of optimizations proposed recently to further improve future designs. Finally, we present a review of recent research published in the area as well as a taxonomy to help readers understand how various contributions fall in context.

Computer Architecture for Scientists

Computer Architecture for Scientists PDF

Author: Andrew A. Chien

Publisher: Cambridge University Press

Published: 2022-03-10

Total Pages: 266

ISBN-13: 1009008382

DOWNLOAD EBOOK →

The dramatic increase in computer performance has been extraordinary, but not for all computations: it has key limits and structure. Software architects, developers, and even data scientists need to understand how exploit the fundamental structure of computer performance to harness it for future applications. Ideal for upper level undergraduates, Computer Architecture for Scientists covers four key pillars of computer performance and imparts a high-level basis for reasoning with and understanding these concepts: Small is fast – how size scaling drives performance; Implicit parallelism – how a sequential program can be executed faster with parallelism; Dynamic locality – skirting physical limits, by arranging data in a smaller space; Parallelism – increasing performance with teams of workers. These principles and models provide approachable high-level insights and quantitative modelling without distracting low-level detail. Finally, the text covers the GPU and machine-learning accelerators that have become increasingly important for mainstream applications.

Computer Architecture

Computer Architecture PDF

Author: John L. Hennessy

Publisher: Morgan Kaufmann

Published: 2017-11-23

Total Pages: 936

ISBN-13: 0128119063

DOWNLOAD EBOOK →

Computer Architecture: A Quantitative Approach, Sixth Edition has been considered essential reading by instructors, students and practitioners of computer design for over 20 years. The sixth edition of this classic textbook from Hennessy and Patterson, winners of the 2017 ACM A.M. Turing Award recognizing contributions of lasting and major technical importance to the computing field, is fully revised with the latest developments in processor and system architecture. The text now features examples from the RISC-V (RISC Five) instruction set architecture, a modern RISC instruction set developed and designed to be a free and openly adoptable standard. It also includes a new chapter on domain-specific architectures and an updated chapter on warehouse-scale computing that features the first public information on Google's newest WSC. True to its original mission of demystifying computer architecture, this edition continues the longstanding tradition of focusing on areas where the most exciting computing innovation is happening, while always keeping an emphasis on good engineering design. Winner of a 2019 Textbook Excellence Award (Texty) from the Textbook and Academic Authors Association Includes a new chapter on domain-specific architectures, explaining how they are the only path forward for improved performance and energy efficiency given the end of Moore’s Law and Dennard scaling Features the first publication of several DSAs from industry Features extensive updates to the chapter on warehouse-scale computing, with the first public information on the newest Google WSC Offers updates to other chapters including new material dealing with the use of stacked DRAM; data on the performance of new NVIDIA Pascal GPU vs. new AVX-512 Intel Skylake CPU; and extensive additions to content covering multicore architecture and organization Includes "Putting It All Together" sections near the end of every chapter, providing real-world technology examples that demonstrate the principles covered in each chapter Includes review appendices in the printed text and additional reference appendices available online Includes updated and improved case studies and exercises ACM named John L. Hennessy and David A. Patterson, recipients of the 2017 ACM A.M. Turing Award for pioneering a systematic, quantitative approach to the design and evaluation of computer architectures with enduring impact on the microprocessor industry

Architectural Intelligence

Architectural Intelligence PDF

Author: Molly Wright Steenson

Publisher: MIT Press

Published: 2022-11-01

Total Pages: 329

ISBN-13: 0262546787

DOWNLOAD EBOOK →

Architects who engaged with cybernetics, artificial intelligence, and other technologies poured the foundation for digital interactivity. In Architectural Intelligence, Molly Wright Steenson explores the work of four architects in the 1960s and 1970s who incorporated elements of interactivity into their work. Christopher Alexander, Richard Saul Wurman, Cedric Price, and Nicholas Negroponte and the MIT Architecture Machine Group all incorporated technologies—including cybernetics and artificial intelligence—into their work and influenced digital design practices from the late 1980s to the present day. Alexander, long before his famous 1977 book A Pattern Language, used computation and structure to visualize design problems; Wurman popularized the notion of “information architecture”; Price designed some of the first intelligent buildings; and Negroponte experimented with the ways people experience artificial intelligence, even at architectural scale. Steenson investigates how these architects pushed the boundaries of architecture—and how their technological experiments pushed the boundaries of technology. What did computational, cybernetic, and artificial intelligence researchers have to gain by engaging with architects and architectural problems? And what was this new space that emerged within these collaborations? At times, Steenson writes, the architects in this book characterized themselves as anti-architects and their work as anti-architecture. The projects Steenson examines mostly did not result in constructed buildings, but rather in design processes and tools, computer programs, interfaces, digital environments. Alexander, Wurman, Price, and Negroponte laid the foundation for many of our contemporary interactive practices, from information architecture to interaction design, from machine learning to smart cities.