Eye On A.I.

Craig S. Smith

  • 56 minutes 7 seconds
    #196 Avi Kedmi: How SysAid Uses AI to Redefine IT Service Management

    This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.

     

    NetSuite is offering a one-of-a-kind flexible financing program. Head to  https://netsuite.com/EYEONAI to know more.

     

     

    In this episode of the Eye on AI podcast, join us as we sit down with Avi Kedmi, CEO of SysAid, to explore the transformative power of AI in IT service management.

     

    Avi shares his journey from the high-tech industry to leading SysAid, a pioneer in IT service management solutions. With over 20 years of experience, Avi discusses how SysAid is leveraging AI to revolutionize service management through predictive modeling and generative AI.

     

    Discover how SysAid's AI-driven solutions reduce ticket volumes and enhance customer satisfaction by automating IT services. Avi provides an inside look at SysAid's AI Co-Pilot, a comprehensive AI suite designed to optimize IT service delivery and support.

     

    Explore the unique features of SysAid's platform, including its ease of use, no-code interface, and seamless integration with existing IT systems. Avi explains how SysAid's AI capabilities enable real-time data processing and decision-making, improving efficiency and response times.

     

    Learn about the future of AI in IT service management, as Avi delves into the potential for AI-driven automation and the development of smarter IT solutions. He also highlights SysAid's strategic approach to staying competitive in a rapidly evolving industry.

     

    Tune in to understand how SysAid is setting new standards in AI-powered IT service management and what this means for the future of IT support.

     

    Don't forget to like, subscribe, and hit the notification bell for more insights into the technologies driving the AI revolution.

     

     

    Get 20% off SysAid Copilot using this link: https://www.sysaid.com/lp/sysaid-copilot-s?utm_source=youtube&utm_medium=cpc&utm_campaign=short-craig

     

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

     

    (00:00) Preview and Introduction

    (02:38) Avi Kedmi's Background

    (04:37) SysAid's Role in the ITSM Market

    (06:39) SysAid Co-Pilot: AI-Powered IT Solutions

    (08:31) Importance of Generative AI in Service Management

    (12:23) Conversational Interfaces and Large Language Models

    (14:20) AI Applications in IT Service Management

    (21:16) Automated Pre-Processing and Document Handling

    (25:33) AI's Role in Reducing Ticket Volumes

    (28:56) Ensuring Accuracy and Relevance

    (30:46) Cross-Channel Accuracy Management

    (34:03) SysAid’s Mid-Market Focus and Strategic Positioning

    (37:52) Market Segmentation and Competitive Advantage

    (39:17) Digitization and Future Market Trends

    (43:54) Challenges with Knowledge Base Maintenance

    (46:48) Future Developments and Industry Trends

    (47:39) SysAid's Vision for AI and IT Service Management

    5 July 2024, 1:00 pm
  • 59 minutes 48 seconds
    #195 Mrinal Manohar: Building Secure AI Systems with Blockchain

    This episode is sponsored by TrialKey.ai, the market leader AI-driven clinical trial design optimization, and predictor that improves trial design and execution. With over 90% accuracy based on precision/recall, TrialKey.ai predicts the success of clinical trials more precisely than any other tool on the market. 

    Maximize clinical trial success while minimizing costs – book a demo at https://trialkey.ai/ or sign up for free! 

     

    In this episode of the Eye on AI podcast, join us as we sit down with Mrinal Manohar, CEO of Casper Labs, to explore the intersection of blockchain technology and AI governance.

     

    Mrinal delves into his journey from Wall Street to founding Casper Labs, a leading enterprise-grade blockchain infrastructure company. With a strong background in computer science and experience in AI governance, Mrinal shares how Casper Labs is setting new standards in AI compliance and security.

     

    Discover how Casper Labs uses blockchain to create tamper-proof, auditable records, ensuring the integrity and security of AI systems. Mrinal explains the innovative use of blockchain for multi-party access and version control, highlighting the company's collaboration with IBM to develop cutting-edge solutions integrated into the Watson X platform.

     

    Explore the implications of upcoming AI legislation, such as the EU AI Act, and how Casper Labs is helping enterprises navigate these regulatory changes. Mrinal provides insights into the challenges and opportunities in AI governance, discussing real-world use cases and the future of secure AI systems.

     

    Learn how Casper Labs is positioning itself ahead of the curve, with technical differentiators and strategic partnerships that set it apart in the industry.

     

    Tune in to understand how Casper Labs is transforming AI compliance and security with blockchain, and what this means for the future of AI.

     

    Don't forget to like, subscribe, and hit the notification bell for more insights into the technologies driving the AI revolution.

     

     

    Checkout Casper Labs:

    Website: https://casperlabs.io/

    Twitter/X: https://x.com/Casper_Labs

     

     

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

     

     

    (00:00) Preview and Introduction

    (01:37) Overview of Casper Labs

    (03:46) Proof of Concept and Collaboration with IBM

    (06:58) AI Governance and Compliance Needs

    (08:38) Key Components of Blockchain for AI Governance

    (10:22) Training Data Integrity and Auditability

    (14:22) Challenges in AI Governance

    (17:15) Real-World Use Cases and Partnerships

    (19:24) Technical Differentiators of Casper Labs

    (23:39) Future Vision and Product Launch

    (26:23) Scalability and Hybrid Networks

    (27:52) Product Integration and User Experience

    (31:54) Support and Onboarding for Enterprises

    (33:11) Building the Blockchain Network

    (36:02) Market Response and Future Prospects

    (39:16) Differentiating from Competitors

    (41:06) Expansion Plans and Future Vision

    (45:43) Global Compliance and Availability

    (55:44) Closing Thoughts 

     

    30 June 2024, 1:00 pm
  • 48 minutes 30 seconds
    #194 Russell Palmer: How AI is Taking Over Hollywood and Changing Filmmaking Forever

    This episode of Eye on AI  is sponsored by BetterHelp.

    If you’re thinking of starting therapy, give BetterHelp a try. It’s entirely online. Designed to be convenient, flexible, and suited to your schedule. Just fill out a brief questionnaire to get matched with a licensed therapist, and switch therapists any time for no additional charge.

    Visit https://www.betterhelp.com/eyeonai today to get 10% off your first month.

    In this episode of the Eye on AI podcast, join host Craig Smith as he engages with Russell Palmer, CEO & Co-Founder at CyberFilm AI.

     

    Russell delves into the transformative journey of integrating AI with storytelling, emphasizing the role of strong narratives in creating impactful AI films. He shares his extensive background, from his early days at Microsoft and JP Morgan to co-founding a startup with his brother that pioneers AI tools for the film industry.

     

    Explore how their innovative app supports writers and filmmakers by offering structured templates, AI-generated plot ideas, character arcs, and storyboards. Discover the startup's mission to democratize filmmaking, making high-quality tools accessible to film students, hobbyists, and professionals alike.

     

    Russell discusses the future of AI in filmmaking, highlighting the potential for AI to enhance creativity, support diverse storytelling, and bridge the gap between aspiring creators and Hollywood-level productions. Learn about their plans to expand features, including video generation and script analysis, while maintaining ethical AI use and respecting intellectual property.

     

    Join us for an insightful conversation on how AI is shaping the future of storytelling and filmmaking, and gain valuable perspectives on navigating this evolving landscape.

     

    Tune in to learn how AI can empower you to create compelling stories and films. 

     

    Don't forget to like, subscribe, and hit the notification bell for more on groundbreaking AI technologies.

    Check out CyberFilms’ Latest Product:

    Website: https://writeonsaga.com

    Social: https://www.tiktok.com/@writeonsaga

     

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

    (00:00) Preview and Introduction

    (02:59) Russell's Background and Early Career

    (05:07) Importance of Story in Filmmaking

    (06:52) Early Reception and Writer Strike Impact

    (08:16) Evolution Video Generation AI Tools

    (11:10) Democratizing Filmmaking for All

    (14:24) AI in Hollywood and Cost Reduction

    (17:21) Addressing Predictability in AI-Generated Stories

    (20:39) Creativity and Originality in AI

    (25:04) Expanding Storytelling to Global and Cultural Narratives

    (29:22) Demonstration of the AI Storytelling App- Saga

    (35:28) Enhancing Script Writing with AI

    (37:59) Integrating Storyboards and Cinematography

    (42:05) Opportunities for Aspiring Filmmakers

    (45:52) Final Thoughts

     

    26 June 2024, 1:10 pm
  • 53 minutes 36 seconds
    #193 Itamar Friedman: How CodiumAI is Making Bug-Free Code a Reality

    This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more.

     

    NetSuite is offering a one-of-a-kind flexible financing program. Head to  https://netsuite.com/EYEONAI to know more. 

    In this episode of the Eye on AI podcast, join host Craig Smith as he sits down with Itamar Friedman, co-founder and CEO of CodiumAI, a pioneering company in the realm of intelligent coding systems.

     

    Itamar shares the ambitious vision of CodiumAI, where developers can aim for zero bugs and issues in their code. Dive into the innovative solutions CodiumAI offers, including Codiumate and PR Agent, tools designed to assist developers in planning, writing, analyzing, and reviewing code with high integrity. 

     

    Explore the concept of flow engineering and how CodiumAI's research project, AlphaCodium, outperforms DeepMind's AlphaCode by using fewer LLM calls and no fine-tuning. 

     

    Itamar delves into the future of coding, where AI not only generates code but ensures its quality through robust verification systems.Itamar offers valuable advice for both developers and enterprises on navigating the evolving landscape of AI in software development.

     

    Tune in to gain insights into how CodiumAI is leading the way in creating a future where coding is more efficient, reliable, and free from bugs.

     

    Don't forget to like, subscribe, and hit the notification bell for more on groundbreaking AI technologies.

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

     

    13 June 2024, 1:00 pm
  • 42 minutes 21 seconds
    #192 Lukas Biewald: How Weights and Biases Supercharges Machine Learning

    This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

    If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

    In this episode of the Eye on AI podcast, join us as we sit down with Lukas Biewald, CEO & co-founder of Weights & Biases, the AI developer platform with tools for training models, fine-tuning models, and leveraging foundation models. 

    Lukas takes us through his journey, from his early days at Stanford and his work in natural language processing, to the founding of CrowdFlower and its evolution into a major player in data annotation. He shares the insights that led him to start Weights and Biases, aiming to provide comprehensive tools for the entire machine learning workflow.

    Lukas discusses the importance of high-quality data annotation, the shift in AI applications, and the role of reinforcement learning with human feedback (RLHF) in refining large models.

    Discover how Weights and Biases helps ML practitioners with data lineage and compliance, ensuring that models are trained on the right data and adhere to regulatory standards. Lukas also highlights the significance of tracking and visualizing experiments, retaining intellectual property, and evolving the company's products to meet industry needs.

    Tune in to gain valuable insights into the world of ML Ops, data annotation, and the critical tools that support machine learning practitioners in deploying reliable models.

    Don't forget to like, subscribe, and hit the notification bell for more on groundbreaking AI technologies.

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

    (00:00) Preview and Intro

    (01:39) Lukas's Background and Career 

    (04:09) Founding CrowdFlower and Early Machine Learning 

    (06:59) Current Trends in Machine Learning

    (08:46) Reinforcement Learning with Human Feedback (RLHF) 

    (12:43) Weights and Biases: Origin and Mission  

    (16:44) Visualizations and Compliance in AI 

    (22:43) US vs. EU AI Regulations

    (25:20) Importance of Experiment Tracking in ML 

    (28:47) Evolving Products to Meet Industry Needs 

    (30:38) Prompt Engineering in Modern AI 

    (33:34) Challenges in Monitoring AI Models 

    (37:25) Monitoring Functions of Weights and Biases

    (39:33) Future of Weights and Biases

    9 June 2024, 1:00 pm
  • 56 minutes 47 seconds
    #191 Jonathan Gillham: AI or Human? Exploring Originality AI's Detection Technology

    This episode is sponsored by Netsuite by Oracle, the number one cloud financial system, streamlining accounting, financial management, inventory, HR, and more. NetSuite is offering a one-of-a-kind flexible financing program.

    Head to https://netsuite.com/EYEONAI to know more.

    In this episode of the Eye on AI podcast, join us as we sit down with Jonathan Gillham, founder of Originality AI, a company specializing in AI detection technology.

     

    Jonathan delves into the origins of Originality AI, born out of the need to distinguish between human and AI-generated content in the content publishing industry. 

     

    Discover how Originality AI uses supervised learning to build sophisticated models that accurately predict the presence of AI in written content, addressing the challenges of AI detection and adversarial prompts.Learn about the diverse use cases of Originality AI, from web publishers to academia, and how the technology helps mitigate the risk of AI-generated spam in the eyes of Google.

     

    Understand the ethical considerations and societal impacts of AI-generated content, and why transparency and labeling are crucial in this evolving landscape. Jonathan also shares insights into the company's business model, growth trajectory, and future developments, including automated fact-checking and enhancing mixed-use case detection.

     

    Tune in to gain valuable insights into how AI detection technology is shaping the future of content publishing and ensuring content authenticity.

     

    Don't forget to like, subscribe, and hit the notification bell for more on groundbreaking AI technologies.

     

    This episode is sponsored by Vanta, The security and compliance platform trusted by more than 7,000 customers.With Vanta, you can unify your security program management with a built-in risk register and reporting, and proactively manage security reviews with AI-powered security questionnaires.

     

    Listeners get $1,000 off Vanta at vanta.com/eyeonai

     

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

    5 June 2024, 1:00 pm
  • 44 minutes 25 seconds
    #190 Peter Cousins: Fighting Financial Crimes with AI

    In this episode of the Eye on AI podcast, join us as we sit down with Peter Cousins, CTO at WorkFusion, a pioneering company in intelligent automation and digital workers for anti-financial crime solutions.

    Peter shares how WorkFusion leverages generative AI and classical AI to combat financial crime and enhance compliance. 

    Discover how AI technologies are revolutionizing sanction screening, adverse media analysis, and KYC processes, reducing manual effort and focusing on high-risk cases.

    Learn about the challenges of implementing generative AI in financial services and how a hybrid approach combining human judgment, classical AI, and generative AI ensures accuracy and reliability. 

    Understand the importance of explainability in AI decisions and how WorkFusion's solutions meet regulatory standards for global financial institutions. 

    Peter also shares insights into the ongoing arms race against financial criminals and the future of AI in the financial industry.

    Tune in to gain valuable insights into how AI is transforming financial services. 

    Don't forget to like, subscribe, and hit the notification bell for more on groundbreaking AI technologies.

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI 

    29 May 2024, 1:00 pm
  • 59 minutes 4 seconds
    #189 Rahul Sonwalkar: The Future of Programming, AI-Powered Code Generation with Julius AI

    This episode is sponsored by TrialKey.ai, the market leader AI-driven clinical trial design optimization, and predictor that improves trial design and execution. With over 90% accuracy based on precision/recall, TrialKey.ai predicts the success of clinical trials more precisely than any other tool on the market. 

    Maximize clinical trial success while minimizing costs – book a demo at https://trialkey.ai/ or sign up for free! 

    In this episode of the Eye on AI podcast, join us as we sit down with Rahul Sonwalkar, founder and CEO of Julius AI, a cutting-edge platform revolutionizing data analysis through AI-powered code generation.

    Rahul shares his inspiring journey from learning to code in high school to founding Julius AI, a tool that helps users analyze datasets, create visualizations, and gain insights using natural language. With over half a million users in just eight months, Julius AI is transforming the way we approach data science and coding.

    Discover the challenges and solutions in AI code generation, as Rahul delves into the complexities of building an AI-native product focused on accuracy. Learn how Julius AI uses a mixture of models and error recovery processes to provide reliable code generation and execution.

    Explore real-world use cases of Julius AI, from financial analysis and biostatistics to web scraping and beyond. Rahul also shares the future vision of programming with AI, where everyone can become a programmer using simple English commands.

    Tune in to understand how Julius AI is setting itself apart from competitors like Microsoft's Copilot and other AI coding tools by prioritizing user-focused problem-solving and community engagement. Rahul's insights into the future of AI programming and the expansion plans for Julius AI are not to be missed.

    Don't forget to like, subscribe, and hit the notification bell for more insights into the groundbreaking technologies driving the AI revolution.

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

    (00:00) Preview and Introduction to Julius AI

    (04:18) Rahul's Background and Journey

    (10:34) Development and Vision for Julius AI

    (14:37) Challenges in AI Code Generation

    (17:07) Acquiring Users and Community Building

    (19:29) Solving the Code Generation Problem

    (23:33) How Julius AI Works

    (33:19) Range of Tasks and Use Cases

    (36:02) Comparison with Competitors

    (39:49) AI Native Products vs. Integrations

    (44:03) Julius AI's Business Model

    (44:23) Live Demo of Julius AI

    (48:14) Success Stories and User Examples

    (51:43) Julius AI's Future Plans and New Features

    (54:54) Translating Complex Documents with AI

    (56:09) Optimism for the Future of AI Programming

    24 May 2024, 1:00 pm
  • 50 minutes 35 seconds
    #188 Edward Balassanian: The Evolution of AI Music

    This episode is sponsored by Vanta, The security and compliance platform trusted by more than 7,000 customers.With Vanta, you can unify your security program management with a built-in risk register and reporting, and proactively manage security reviews with AI-powered security questionnaires.

    Listeners get $1,000 off Vanta at vanta.com/eyeonai

     

    In this episode of the Eye on AI podcast, join us for an insightful conversation with Edward Balassanian, CEO and founder of Aimi, a trailblazer in the realm of generative AI music.

    Edward takes us through his fascinating journey from engineering and computer science to pioneering a platform that transforms music into a dynamic, interactive service. Aimi’s innovative approach to AI-generated music is redefining the industry by enabling both amateurs and professionals to create high-quality, customized music.

    Discover the technical and legal challenges unique to the AI music space, and how Aimi’s bottom-up approach to music creation sets it apart from other AI music initiatives. Edward delves into the complexities of training models with ethically sourced, high-quality data, and explains the importance of maintaining human elements in generative music.

    Explore the vast potential of music as a service and how Aimi is revolutionizing industries like gaming, social media, and content creation by integrating seamless, non-repetitive music into various applications. Edward also shares real-world examples and future plans for Aimi, emphasizing the role of AI in amplifying human creativity.

    Tune in to understand the transformative impact of AI on music and how Aimi is leading the charge in this exciting frontier.

    Don't forget to like, subscribe, and hit the notification bell for more insights into the cutting-edge technologies driving the AI revolution.

    This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

    If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

    20 May 2024, 1:00 pm
  • 57 minutes 36 seconds
    #187 Mohamed Elgendy: Systematic Testing for Generative AI Models with Kolena

    This episode is sponsored by Oracle. AI is revolutionizing industries, but needs power without breaking the bank. Enter Oracle Cloud Infrastructure (OCI): the one-stop platform for all your AI needs, with 4-8x the bandwidth of other clouds. Train AI models faster and at half the cost. Be ahead like Uber and Cohere.

    If you want to do more and spend less like Uber, 8x8, and Databricks Mosaic - take a free test drive of OCI at https://oracle.com/eyeonai

    In this episode of the Eye on AI podcast, join us as we dive into the realm of AI quality assurance with Mohamed Elgendy, CEO and co-founder of Kolena. 

    Discover the intricacies of ensuring robust AI performance as Mohamed shares his journey from a software engineer to leading an AI quality platform. Kolena is setting new standards in AI testing, addressing the non-deterministic nature of machine learning models with a systematic framework for validation.

    The conversation navigates the challenges of AI testing, the importance of structured quality assurance, and the collaboration with industry bodies to shape the future of AI standards. Mohamed elaborates on Kolena's innovative approach to both human and automated evaluations, providing comprehensive testing solutions tailored to diverse customer needs.

    We also explore real-world use cases and the platform's future plans to make AI testing more accessible and reliable. Mohamed's insights illuminate the path toward achieving high-quality AI systems, ensuring they perform as intended across various applications.

    Tune in to understand the advancements propelling AI quality forward and how Kolena is pioneering the way in this crucial aspect of AI development.

    Don't forget to like, subscribe, and hit the notification bell for more insights into the technologies driving the AI revolution.

    This episode is sponsored by Shopify. Shopify is a commerce platform that allows anyone to set up an online store and sell their products. Whether you’re selling online, on social media, or in person, Shopify has you covered on every base. With Shopify you can sell physical and digital products. You can sell services, memberships, ticketed events, rentals and even classes and lessons.

    Sign up for a $1 per month trial period at http://shopify.com/eyeonai

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

    18 May 2024, 1:00 pm
  • 1 hour 10 minutes
    #186 Ronen Dar: Maximizing GPU Utilization for AI with Run:ai

    This episode is sponsored by 1Password. 1Password combines industry-leading security with award-winning design to bring private, secure, and user-friendly password management to everyone. Companies lose hours every day just from employees forgetting and resetting passwords. A single data breach costs millions of dollars. 1Password secures every sign-in to save you time and money.

    Right now, my listeners get a free 2-week trial at:  https://www.1password.com/eyeonai

    In this episode of Eye on AI, join us as we explore the cutting-edge world of GPU optimization with Ronen Dar, CTO and co-founder of Run:ai. 

    Delve into the intricacies of managing and maximizing GPU utilization in an era marked by a severe GPU shortage. Ronen shares his insights on how Run:ai's innovative software is revolutionizing AI infrastructure, making GPU resources more efficient and accessible.

    The conversation spans the technical challenges of scaling AI models, the evolution of GPU demands from basic algorithms to complex systems like GPT-4, and the strategic innovations helping enterprises overcome these hurdles. Ronen also reflects on the future of AI development, predicting an exponential increase in demand for computational power and the innovative solutions poised to meet these needs.

    Tune in to uncover the technological advancements that are propelling AI capabilities forward and shaping the future of AI deployment across industries.

    Don't forget to like, subscribe, and hit the notification bell for more deep dives into the technologies that are transforming our digital landscape.

    Stay Updated:

    Craig Smith Twitter: https://twitter.com/craigss

    Eye on A.I. Twitter: https://twitter.com/EyeOn_AI

    (00:00) Preview

    (02:46) Introducing Ronen Dar

    (04:00) Ronen's background and RunAI's origins

    (09:13) The need for efficient GPU utilization in AI

    (13:14) RunAI's core value proposition

    (15:33 RunAI's deployment model

    (18:55) The growing demand for compute power and GPUs

    (22:08) Challenges in scaling models beyond 70 billion parameters

    (27:52) RunAI's open platform approach

    (31:00) Addressing latency and throughput challenges in inference

    (34:36) RunAI's integration with AI tools and frameworks

    (39:37) Reducing the cost of inference with GPU virtualization

    (43:54) Challenges in auto-scaling for large language models

    (47:06) The future of the GPU market and demand

    (50:49) NVIDIA's dominance and the role of competitors like Cerebras

    (54:20) RunAI's global customer base and demand patterns

    (57:52) NVIDIA's vision and the evolution of GPU architectures

    (01:01:25) Compute requirements for the metaverse and future AI applications

    (01:03:56) Concerns about power consumption and carbon footprint

    12 May 2024, 1:00 pm
  • More Episodes? Get the App
© MoonFM 2024. All rights reserved.