This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting and resetting passwords. A single data breach costs millions of dollars. 1Password secures every sign-in to save you time and money.

Right now, my listeners get a free 2-week trial at:  https://www.1password.com/eyeonai

In this episode of Eye on AI, join us as we explore the cutting-edge world of GPU optimization with Ronen Dar, CTO and co-founder of Run:ai. 

Delve into the intricacies of managing and maximizing GPU utilization in an era marked by a severe GPU shortage. Ronen shares his insights on how Run:ai's innovative software is revolutionizing AI infrastructure, making GPU resources more efficient and accessible.

The conversation spans the technical challenges of scaling AI models, the evolution of GPU demands from basic algorithms to complex systems like GPT-4, and the strategic innovations helping enterprises overcome these hurdles. Ronen also reflects on the future of AI development, predicting an exponential increase in demand for computational power and the innovative solutions poised to meet these needs.

Tune in to uncover the technological advancements that are propelling AI capabilities forward and shaping the future of AI deployment across industries.

Don't forget to like, subscribe, and hit the notification bell for more deep dives into the technologies that are transforming our digital landscape.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview

(02:46) Introducing Ronen Dar

(04:00) Ronen's background and RunAI's origins

(09:13) The need for efficient GPU utilization in AI

(13:14) RunAI's core value proposition

(15:33 RunAI's deployment model

(18:55) The growing demand for compute power and GPUs

(22:08) Challenges in scaling models beyond 70 billion parameters

(27:52) RunAI's open platform approach

(31:00) Addressing latency and throughput challenges in inference

(34:36) RunAI's integration with AI tools and frameworks

(39:37) Reducing the cost of inference with GPU virtualization

(43:54) Challenges in auto-scaling for large language models

(47:06) The future of the GPU market and demand

(50:49) NVIDIA's dominance and the role of competitors like Cerebras

(54:20) RunAI's global customer base and demand patterns

(57:52) NVIDIA's vision and the evolution of GPU architectures

(01:01:25) Compute requirements for the metaverse and future AI applications

(01:03:56) Concerns about power consumption and carbon footprint

This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.

NetSuite is offering a one-of-a-kind flexible financing program. Head to  https://netsuite.com/EYEONAI to know more.

Unlock the secrets of clinical trial predictions with Saurabh Jain and Damon Rasheed from Opyl & TrialKey.ai on this episode of Eye on AI.

In today’s discussion, delve into how TrialKey's pioneering AI model can predict the success of clinical trials with astonishing accuracy—about 90%. Learn about the innovative use of over 400,000 past trials to enhance the precision and efficiency of new pharmaceutical trials. Saurabh and Damon share how their technology not only predicts outcomes but also optimizes trial design, saving substantial time and resources in the drug development process.

The episode also covers the sophisticated data processing techniques employed by TrialKey, including natural language processing to extract vital variables from complex datasets, and the strategic use of these insights to improve trial designs. Discover the implications of poorly designed trials and how AI can revolutionize their structure for better success rates.

Tune in to gain a deeper understanding of how AI and machine learning are transforming the pharmaceutical landscape, making clinical trials more predictive and efficient. Saurabh and Damon’s expertise offers a glimpse into the future of medical research and investment, emphasizing the role of AI in enhancing decision-making and resource allocation in healthcare.

Remember to like, subscribe, and hit the notification bell to keep up with the latest innovations and discussions reshaping the future of artificial intelligence and healthcare.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

Dive into the cutting-edge realm of neuromorphic computing with André van Schaik, a professor of electrical engineering at the Western Sydney University, and director of the International Centre for Neuromorphic Systems, in Penrith, New South Wales, Australia

In this episode of Eye on AI, André unveils the capabilities of DeepSouth, an innovative brain-scaled neuromorphic computing system designed to simulate up to 100 billion neurons in real time. Discover how DeepSouth leverages spiking neurons and synapses to process information more efficiently than traditional AI models, and how this technology could transform our understanding of brain computation and unlock new AI architectures.

The conversation explores the unique hardware setup of DeepSouth, utilizing FPGAs (Field-Programmable Gate Arrays) for a flexible, reconfigurable approach that mimics the asynchronous and spiking communication of biological neurons. 

André discusses the initial testing phase focusing on balanced excitation-inhibition networks, reflecting common neural activities in the human cortex, and outlines the system's potential to facilitate large-scale simulations previously unachievable due to computational constraints.

André's insights are invaluable for anyone interested in the intersection of neuroscience, artificial intelligence, and computational technology.

Don't forget to like, subscribe, and hit the notification bell to stay updated on the latest breakthroughs and discussions in the world of artificial intelligence.

This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Introduction

(02:19) André van Schaik's background

(03:39) What is neuromorphic computing?

(05:45) Differences between Von Neumann and neuromorphic architectures

(09:27) How DeepSouth simulates neurons

(12:20) What are FPGAs?

(16:42) Current status of DeepSouth

(19:04) Running neural network architectures on DeepSouth

(22:33) DeepSouth as an open source, commercial hardware

(24:40) Potential for cheaper model training

(28:35) Number of neurons and connections in DeepSouth

(30:01) Power consumption comparison

(34:21) Mimicking brain structures in DeepSouth

(35:42) André van Schaik's background in neuroscience

(39:12) Goals of understanding brain activity vs solving problems

(41:44) Interest from AI research community

(43:03) Summary of DeepSouth's goals

This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting and resetting passwords. A single data breach costs millions of dollars. 1Password secures every sign-in to save you time and money.

Right now, my listeners get a free 2-week trial at: www.1password.com/eyeonai

Explore the world of AI development with Will Falcon, creator of PyTorch Lightning and founder of Lightning AI.

In this episode of Eye on AI, Will takes us through the groundbreaking journey of Lightning Studio, a revolutionary cloud-based platform that's reshaping how AI tools and frameworks are integrated and scaled. From his unique start in the US military to leading AI innovation, Will offers a comprehensive look at the evolution of machine learning technologies that simplify and accelerate the deployment of AI models.

The discussion delves into the creation of PyTorch Lightning, highlighting its role in democratizing AI development by structuring code and enabling scalability across thousands of machines. Will also outlines the pivotal shift from traditional coding practices to a streamlined, cloud-based environment, making advanced AI tools accessible to a global community of developers.

Tune in as we uncover the layers of technology that drive AI forward and discuss the future of AI development platforms.

Will's insights are crucial for anyone interested in the intersection of AI, software engineering, and cloud infrastructure.

Make sure to hit the like button and subscribe for more insights into the technologies shaping our world.

This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting and resetting passwords. A single data breach costs millions of dollars. 1Password secures every sign-in to save you time and money.

Right now, my listeners get a free 2-week trial at: www.1password.com/eyeonai

Dive into the world of autonomous driving with Dragomir Anguelov, Vice President, Head of Research at Waymo, in this captivating episode of Eye on AI.

Drago offers a profound exploration into the technical and operational advancements driving the future of autonomous vehicles. With his rich background at Google and now at Waymo, Drago provides an insider’s view on the evolution of machine learning technologies and their pivotal role in developing self-driving cars that are not only intelligent but also safe and reliable.

This conversation spans the inception of large neural networks for image understanding to the intricate deployment of robotaxis in urban environments. Drago details the challenges of scaling these complex systems across different cities and the breakthroughs that have made autonomous driving a tangible reality in places like Phoenix and San Francisco.

Drago’s insights are invaluable for anyone interested in the convergence of AI, robotics, and transportation.

If you are fascinated by the advancements being made in the autonomous driving space and how they could transform our daily lives, make sure to hit the like button and subscribe for more deep dives into the technologies shaping our future.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.

NetSuite is offering a one-of-a-kind flexible financing program. Head to  https://netsuite.com/EYEONAI to know more. 

Venture into the future of AI with Nick Bostrom, a philosopher at the University of Oxford known for his work on existential risk, the anthropic principle, human enhancement ethics, whole brain emulation, superintelligence risks, and the reversal test.

On episode #181 of Eye on AI, Nick Bostrom, explores the existential and societal implications of AI reaching and surpassing human capabilities. As we contemplate a world where all tasks are performed by AI, Nick discusses the potential for a 'technologically solved' society and its impact on human purpose and motivation.

Join us as Nick provides insights into his latest book, "Deep Utopia," where he questions how humans will find meaning when artificial intelligence handles every aspect of labor and creativity. He elaborates on the risks, ethical considerations, and philosophical dilemmas we face as AI continues to evolve at an unprecedented pace.

This episode is an essential exploration of the shifts AI may bring to our societal structures, labour markets, and individual lives. 

If you find yourself intrigued by the philosophical journey into AI's potential to redefine humanity, hit the like button and subscribe for more thoughtful discussions on the future landscapes shaped by artificial intelligence.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Introduction and the Concept of a 'Solved World'

(03:05) Nick Bostrom's Background

(06:06) Exploring the Anthropomorphism in Modern AI

(08:02) Predictions and the 'Hockey Stick' Graph

(10:13) AI Safety and Public Perception

(12:58) Deep Utopia and the Search for Meaning

(15:46) Life in a Technologically Mature World

(18:17) Existential Malaise in Modern Society

(20:43) The Potential of Technological Maturity

(23:51) Philosophical Implications of a Solved World

(28:20) Engineering Happiness and Neurological Adjustments

(32:18) Remaining Human Tasks and Cultural Values

(35:45) The Future of Humanity

(47:03) Closing Remarks and Sponsor Message

This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

Explore the journey of AI within the technology industry with Thomas Lah in episode #180 of Eye on AI.

This dialogue features Thomas Lah, Executive Director of the Technology and Services Industry Association (TSIA), as he delves into the influence of AI on technology companies and their operating models.

In this episode, Thomas offers a compelling narrative on how AI is being integrated into the fabric of technology businesses, altering the landscape of innovation and competition. Discover the intricacies of AI adoption strategies, the challenges of data management, and the evolution of business models in response to AI advancements. From Microsoft to Salesforce, uncover how leading tech giants are harnessing AI to redefine efficiency, creativity, and growth.

Dive deep into the core of TSIA's research, unveiling the pivotal role of benchmarking and operational research in navigating the AI revolution. Thomas sheds light on the actionable insights and best practices that are guiding technology companies through this era of rapid technological change.

Whether you're intrigued by the operational shifts AI is catalyzing in the tech sector, or you're keen on understanding the future directions of AI-driven business models, this episode is a treasure trove of knowledge.

Remember to give us a thumbs up on YouTube if this deep dive into the AI transformation within tech companies enriches your understanding. 

Subscribe for more insights into how AI is sculpting the technological landscapes of tomorrow.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Introduction  (01:19) AI’s Impact on Tech Companies' Internal Processes (04:22) Thomas Lah’s Background and Contributions to Tech Services (07:49) Future Trends: AI Agents and Physical World Actions (10:12) Real-World AI Use Cases and ROI in Tech Companies (13:44) The Rapid Maturation of AI Tools and Its Impact (16:48) The Right Timing for AI Adoption and Investment (20:09) AI Advantaged vs. Severely Lagged Tech Companies (25:31) Addressing the Consumption Gap with AI in Education (32:17) AI in Operations (38:35) The Evolution of AI Agents and Co-Pilots in Tech Services (45:12) Centralizing and Rationalizing Data for AI Readiness (48:31) Cultural and Technical Shifts Required for AI Integration (51:06) AI's Impact on Business Models and Headcount Reductions

Dive into the heart of the AI race between the US and China with Craig Smith in episode #179 of Eye on AI. 

This discussion features Ylli Bajraktari, the President and CEO of the Special Competitive Studies Project, as he unveils the strategic maneuvers and policies shaping the future of artificial intelligence on a global scale.

In this episode, Ylli provides an in-depth analysis of the current state of AI development and competition, illuminating the actions taken by both superpowers to secure their position at the forefront of technological advancement. From the pivotal CHIPS Act to the formation of national AI champions, learn how these initiatives are influencing the global AI landscape.

Uncover the essence of the Special Competitive Studies Project and its mission to ensure the US retains its edge in AI through a comprehensive, nation-wide approach. Ylli discusses the critical importance of AI in national security, the transformative potential of the OffsetX strategy, and the implications of the National Plan for Microelectronics.

Whether you're fascinated by the strategic dynamics of international technology competition or passionate about the impact of AI on society and security, this episode offers invaluable insights into the challenges and opportunities ahead.

Don't forget to rate us on Apple Podcast and Spotify if you're inspired by the strategic discourse on AI's role in shaping the future.

This episode is sponsored by Shopify. Shopify is a commerce platform that allows anyone to set up an online store and sell their products. Whether you’re selling online, on social media, or in person, Shopify has you covered on every base. With Shopify you can sell physical and digital products. You can sell services, memberships, ticketed events, rentals and even classes and lessons.

Sign up for a $1 per month trial period at http://shopify.com/eyeonai

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview

(00:46) Introducing Ylli Bajraktari

(04:21) Origins of the Special Competitive Studies Project

(09:14) Influence of National Security Commission on AI

(14:05) What is the OffsetX Strategy

(15:42) US vs. China: The AI Competition Landscape

(19:00) Post-Gen AI Period and Its Impact

(21:03) The Future of AI Research

(24:41) Reorganizing Government Institutions for the AI Era

(32:48) Understanding Lethal Autonomous Weapon Systems

(35:05) The Concept of Counter-Autonomy

(39:04) Addressing the Threat from China’s Semiconductor Strategy

(44:54) Preview of the Special Competitive Studies Project's AI Expo

This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

Join host Craig Smith in episode #178 of Eye on AI for an enlightening conversation with Terry Sejnowski, President of the NeurIPS Foundation and is the Francis Crick Professor at the Salk Institute for Biological Studies where he directs the Computational Neurobiology Laboratory 

In this episode, Terry shares his unique insights into the evolution of neural networks, the monumental impact of models like GPT-4, and the intricate relationship between AI technologies and societal norms. Learn about the future trajectory of AI development, as Terry highlights the importance of integrating human brain development aspects into AI to foster models that better understand and integrate into human culture.

Discover Terry's perspective on the role of reinforcement learning in AI, the challenges of aligning AI with ethical considerations, and the potential of neuromorphic engineering to revolutionize energy-efficient computing. This discussion also touches on the implications of AI in reshaping industries, science, and the global workforce.

An essential listen for those fascinated by the ethical dimensions of AI, the potential of neuroscience to inform AI development, and the broader societal impacts of technological advancement. 

If you're drawn to the complexities of AI and its potential to redefine our future, don't forget to rate us on Apple Podcast and Spotify.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Introduction to Terry Sejnowski 

(01:54) Bridging Computational Neuroscience with AI Development

(05:24) Biological Principles in AI: Learning and Adaptation

(07:07) The Crucial Role of Reinforcement Learning in AI

(10:12) Breakthroughs in AI: Scaling Models and Language Processing

(13:38) The Rapid Pace of AI Evolution: Implications and "AI Time"

(16:58) Ethical Considerations and AI Alignment Challenges

(20:23) Neuromorphic Engineering and Energy Efficiency

(25:42) Real-world Applications: AI's Expanding Role in Society

(29:04) The Developmental Approach: Training AI with Human Nuances

(33:32) The Impact of AI on Science and Discovery

(40:19) AI Education and Lifelong Learning: Overcoming Barriers

(43:20) MOOCs and the Democratization of Learning in the AI Era

(47:08) Balancing Innovation and Safety in the Accelerating AI Landscape

Join host Craig Smith on episode #177 of Eye on AI as he explores the cutting-edge world of generative models in artificial intelligence with Björn Ommer, a visionary AI researcher and Head of Computer Vision & Learning Group at Ludwig Maximilian University of Munic.

In this episode, Björn delves into the fascinating inner workings of diffusion models, shedding light on the pivotal role these models play in advancing technology and society. Discover the groundbreaking development of stable diffusion, a key innovation by Bjorn's team that is setting new standards in the democratization of AI technology.

Learn about the challenges and solutions in making AI accessible on consumer hardware, ensuring that the power of generative AI is not confined to well-funded organizations but available to all. Bjorn shares his expert insights on the balance between open-source innovation and proprietary development, emphasizing the societal implications of generative AI.

This episode is an essential listen for anyone intrigued by the potential of AI to transform our understanding of the visual world, the importance of accessibility in technology, and the future of AI development.

If you're captivated by the evolution of AI and the profound impact of generative models like stable diffusion, don't forget to rate us on Apple Podcast and Spotify. 

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Introduction

(01:38) Bjorn Omer's Journey into AI

(03:03) The Evolution of AI Before Deep Learning

(06:38) Democratizing AI with Stable Diffusion

(09:45) Explaining Diffusion Models

(13:40) Challenges of AI on Consumer Hardware

(17:05) The Binding Problem in Vision Research

(22:27) Mechanisms in Stable Diffusion: Attention and Diffusion Processes

(26:09) Open Source vs. Proprietary AI Models

(30:16) Making Compute Resources More Accessible

(34:30) Reducing Compute Requirements in AI Models

(38:52) The Concept of World Models in AI Research

(41:50) The Future of AI and the Fallacy of Scaling

Join host Craig Smith on episode #176 of Eye on AI as he dives deep into the realm of robotic artificial intelligence with Sergey Levine, associate professor in the Department of Electrical Engineering and Computer Sciences at UC Berkeley. 

In this episode, Sergey unveils the latest advancements in AI control of robots, exploring the implications of reinforcement learning and the concept of embodied AI. 

Discover how Sergey's research is pushing the boundaries of AI, enabling robots to learn manipulation skills and generalize across diverse tasks, transforming the potential of home robots and beyond.

Sergey also shares insights into the RTX project, an ambitious collaboration designed to achieve remarkable generalization across different robot morphologies, enhancing robots' ability to perform language-conditioned manipulation tasks.

If you're fascinated by the intersection of AI, robotics, and the quest for creating adaptable, generalizable machines that promise to revolutionize our interaction with technology, this episode is a must-listen. 

Remember to rate us on Apple Podcast and Spotify if this episode ignites your interest in the dynamic field of robotic AI and the visionary work of Sergey Levine.

Stay Updated:

Craig Smith Twitter: https://twitter.com/craigss

Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

(00:00) Preview and Introduction to Home Robots and AI in Robotics

(01:43) World Models and Language Models in Robotics

(04:01) The Challenge of Learning-Based Control and Data Utilization

(06:05) RTX Project: Generalizing Controllers Across Different Robots

(10:09) Uniformity in Model Architecture Across Labs

(13:50) Introduction of RT1 and RT2 Models for Robot Control

(16:06) The Future of Robotic Control Research and Architecture

(18:49) The Impact of Hardware Development on Robotics

(22:15) Advances in Controller and AI Model Development

(26:21) Planning and Acting with Vision Language Models

(31:38) The Proprietary vs. Open-Source Debate in Robotics

(36:23) The Future of Commercial and Open Source Robotics Applications

(40:59) The State of Robotics Research in China