The Enterprise AI Show

Latest Episodes:

Validation and Guardrails for LLMs Feb 21, 2024

Show notes

Shreya Rajpal (@ShreyaR, CEO @guardrails_ai ) talks about the need to provide guardrails and validation of LLM’s, along with common use cases and Guardrail AI’s new Hub.
SHOW: 797
CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw
NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"
SHOW SPONSORS:

Learn More About Azure Offerings : Learn more about Azure Migrate and Modernize & Azure Innovate!
Azure Free Cloud Resource Kit : Step-by-step guidance, resources and expert advice, from migration to innovation.CloudZero – Cloud Cost Visibility and Savings
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to date with Enterprise Tech with theCUBE

SHOW NOTES:

Topic 1 - Welcome to the show. Before we dive into today’s discussion, tell us a little bit about your background.
Topic 2 - Our topic today is the validation and accuracy of AI with guardrails. Let’s start with the why… Why do we need guardrails for LLMs today?
Topic 3 - Where and how do you control (maybe validate is a better word) outputs from LLM’s today? What are your thoughts on the best way to validate outputs?
Topic 4 - Will this workflow work with both closed-source (ChatGPT) and opensource (Llama2) models? Would this process apply to training/fine-tuning or more for inference? Would this potentially replace humans in the loop that we see today or is this completely different?
Topic 5 - What are some of the most common early use cases and practical examples? PII detection comes to mind, violation of ethics or laws, off-topic/out of scope, or simply just something the model isn’t designed to provide?
Topic 6 - What happens if it fails? Does this create a loop scenario to try again?
Topic 7 - Let’s talk about Guardrails AI specifically. Today you offer an open-source marketplace of Validators in the Guardrails Hub, correct? As we mentioned earlier, almost everyone’s implementation and guardrails they want to implement will be different. Is the best way to think about this as building blocks using validators that are pieced together? Tell everyone a little bit about the offering
FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Experiencing The Sphere in Las Vegas Feb 18, 2024

Show notes

Stu Miniman (@stu, Senior Director of Market Insights @RedHat) talks about the experience of The Sphere (@SphereVegas) in Las Vegas

SHOW: 796

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend

SHOW NOTES:

Topic 1 - Welcome back to the show. I think it’s fair to say that you’re a veteran of Las Vegas. How many times do you think you’ve been out there for tech-event related things?

Topic 2 - With tech events coming back, and even non-tech events going live again, Las Vegas is going to be a destination for a lot of people around our community. What did you know about The Sphere prior to visiting this past week?

Topic 3 - Tell us about the basics of The Sphere. How do you get there? Where is it in Las Vegas? What’s the entrance like?

Topic 4 - Beyond the movies or concerts in the stadium, what else is going on in the building?

Topic 5 - Let’s talk about the actual stadium experience. What’s the seating like, what are you seeing, how’s the sound?

Topic 6 - Any tips or tricks for anyone considering a visit to The Sphere?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

APIs and AI Gateways Feb 14, 2024

Show notes

Marco Palladino (@subnetmarco, CTO/Co-Founder @thekonginc) talks about the evolution of APIs, the need for consolidation and integration of AI APIs, and introduces the AI Gateway.

SHOW: 795

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to date with Enterprise Tech with theCUBE

SHOW NOTES:

Kong (homepage)
What is an AI Gateway?
Kong launches AI Gateway (Marco's blog on Kong homepage)
Kong introduces AI Gateway (Silicon Angle)
Hugging Face (AI model community)

Topic 1 - Welcome to the show. Before we dive into today’s discussion, tell us a little bit about your background at Kong and prior to Kong.
Topic 2 - Now that the world is obsessed with AI and AI Models, what roles do APIs continue to play for applications?
Topic 3 - You’ve lived through the API marketplace days. Do you see a lot of differences between API marketplaces and model marketplaces (e.g. like HuggingFace)?
Topic 4 - You’ve talked recently about the concept of an AI Gateway, somewhat as an evolution of an API Gateway. Walk us through this new concept.
Topic 5 - API Gateways can provide a lot of protection for known things by looking into various headers, security keys, and packet data. Can you imagine AI Gateways being able to have insights into model data to do things like Prompt Control, Hallucination Control, etc.?
Topic 6 - We’ve seen the merging of API Gateways (North/South) and Service Mesh (East/West) traffic as new application patterns emerged. Do you think we’ll see new traffic patterns again with AI traffic and AI model interactions?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

The Curious Case of AI, Funding and Cloud Credits Feb 11, 2024

Show notes

Big 3 cloud providers investing in AI with cloud credits. $7 trillion dollar big plans. VCs concerned about AI valuations. It feels like a new set of rules are being created.

SHOW: 794

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
Learn More About Azure Offerings : Learn more about Azure Migrate and Modernize & Azure Innovate!
Azure Free Cloud Resource Kit : Step-by-step guidance, resources and expert advice, from migration to innovation.CloudZero – Cloud Cost Visibility and Savings

SHOW NOTES:

ARE CLOUD CREDITS THE NEW VENTURE CAPITAL?

“Microsoft's Q2 2024 earnings report states that AI services contributed 6 percentage points of growth to Azure revenue. This is an increase from 3 percentage points in the previous quarter.”

KEEP AN EYE ON AI USAGE “TRENDS” FROM THE BIG CLOUD PROVIDERS

Is this a problem for VCs?
Is this “good” revenue for the cloud providers?
Are they just smart for utilizing an asset that they can monopolize?
How to track user-growth (e.g. OpenAI) and cloud-usage-growth (e.g. Big 3)
How much will people invest to build an alternative to NVIDIA?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Cloud News of the Month Feb 07, 2024

Show notes

Welcome to the inaugural Cloud News of the Month. Aaron and Brian talk about the biggest tech stories from January 2024.

SHOW: 793

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE

SHOW NOTES:

Topic 1 - Let’s begin with the state of work - employees vs. management.
Topic 2 - Lots of changes finally announced by Broadcom about the new VMware (here, here)
Topic 3 - We’re starting to see the end of the Unicorns of 2021. This feels like it’s going to be a quiet crash.
Topic 4 - The CNCF and Linux foundation released some project velocity numbers. Looks like Kubernetes, GitOps, Telemetry, Backstage are at the top, with some noise around Envoy/Istio/Cilium
Topic 5 - There was a lot of buzz around Basecamp’s numbers for repatriating back to their private cloud.
Topic 6 - AI Speed Round...

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Bundling, Unbundling and Ensh*tification Feb 04, 2024

Show notes

Some say the Internet has gone to sh*t. Between bundling and unbundling, how does “ensh*tification” happen, and are there ways to prevent or reduce it?

SHOW: 792

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Learn More About Azure Offerings : Learn more about Azure Migrate and Modernize & Azure Innovate!
Azure Free Cloud Resource Kit : Step-by-step guidance, resources and expert advice, from migration to innovation.CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend

SHOW NOTES:

How does anyone use the Internet? (SDT eps.451)
“Enshitification” - The 2023 Digital Word of the Year
Enshitifcation is also known as platform decay (Wikipedia)
How to success in business by bundling and unbundling (Jim Barksdale)

IN THE DIGITAL WORLD, IT’S EASY TO BUNDLE THINGS TOGETHER

The only way to unlock valid is through bundling and unbundling
There is a fine line between innovation, growth and platform creep.
Nobody likes when free stuff goes away or gets complicated

CAPITALISM, FREE-ISM, AND ALIGNMENT OF INCENTIVES

Expected growth rates are set by the companies.
People in tech are always asking “what’s next?”
There’s a difference between early adopters and mainstream

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

VCs and Open Source and Funding Jan 31, 2024

Show notes

Aneel Lakhani (@aneel, Investor, @crane_vc Crane Venture Partners) talks about the challenges of VC funding and building profitable companies based on open-source software.

SHOW: 791

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
Learn More About Azure Offerings : Learn more about Azure Migrate and Modernize & Azure Innovate!
Azure Free Cloud Resource Kit : Step-by-step guidance, resources and expert advice, from migration to innovation.CloudZero – Cloud Cost Visibility and Savings

SHOW NOTES:

Crane VC homepage
Aneel’s 2023 Look Ahead Show
Aneel’s 2022 Look Ahead Show
The Problem with Money in (Open Source) Software - Monktoberfest 2023

Topic 1 - Welcome back. You’re almost in the 5 timers club at this point, and a returning guest from our look-ahead shows in 2023. For our new listeners, tell everyone a little bit about yourself

Topic 2 - You recently gave a talk at Monktoberfest about the problem with money in software, specifically open-source software. The crux of it was that VCs require high returns on investments, and software has short windows to gain adoption.

Topic 3 - Could that talk have been given any time over the last 5+ years, or was it triggered by recent “events” with open source companies (e.g. Hashicorp)?

Topic 4 - Has VC thinking changed about software, given that open source provided essentially early marketing and awareness for “free,” but that comes with user expectations of free (cost) as well? Are there any new ideas about how to build cost-effective software moats?

Topic 5 - There are various “conspiracies” floating around that VCs negotiate “the rug pull” with companies at each funding round. Especially in the early stages (where you focus), how much is the VC focused on getting the idea off the ground vs. the validity of the business model? When does the business model discussion typically start?

Topic 6 - We’ve said before that there will never be another Enterprise Software company after VMware. Has the era of open-source enterprise startups ended, or does it just need to go through a phase of rediscovery?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Harnessing AI for Enterprise Adoption Jan 28, 2024

Show notes

Every company is trying to figure out how to harness the power of AI. Let’s look at some frameworks to accelerate innovation, allow for experimentation, and manage long-term success.

SHOW: 790

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE
Datadog Application Monitoring: Modern Application Performance Monitoring
Get started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.

SHOW NOTES:

Harnessing AI’s Full Potential for Enterprise Adoption (Forbes)

GETTING STARTED AND ESTABLISHING THE FUNDAMENTALS

Does the business have an existing Data Science team?
Does the business have an existing culture of experimentation?
What is the business trying to change or improve?

EARLY SUCCESS, MATURITY MODELS, AND ENTERPRISE COMPLEXITIES

Aligning AI Strategy With Business Goals
Cultivating An AI-Friendly Culture
Skills And Expertise
Ethics And Trust
Data Management And Protection

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Wiring the Winning Organization Jan 24, 2024

Show notes

Gene Kim (@RealGeneKim, Author, Organizational Operations Researcher) talks about the challenges of organizing a team, group, or company to be successful in simple and complex tasks.
SHOW: 789
CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw
NEW TO CLOUD? CHECK OUT OUR OTHER PODCAST - "CLOUDCAST BASICS"
SHOW SPONSORS:

Learn More About Azure Offerings : Learn more about Azure Migrate and Modernize & Azure Innovate!
Azure Free Cloud Resource Kit : Step-by-step guidance, resources and expert advice, from migration to innovation.CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend

SHOW NOTES:

Wiring the Winning Organization (book) (w/ Steven Spear)
The Unicorn Project (homepage)
The Unicorn Project (resource guide)
The Unicorn Project on The Cloudcast (Eps. 433)
The Phoenix Project on The Cloudcast (Eps.79)
The DevOps Handbook
DevOps Enterprise Summit (event)

Topic 1 - Welcome back. It’s been way too long. What have you been up to lately? Tell us a little bit about your co-author and where the research for this book came from.
Topic 2 - This is a different type of book than The Phoenix Project or Unicorn Project, in that it seems more about managerial structure and research than the inspirational story-telling of past books. Is this addressing a different audience, or you felt that it needed a different framework to make the biggest impact?
Topic 3 - At the core of the book are three concepts, amplification (where are the problems) which results in slowificaion (create space for problem solving) and simplification (make problems themselves easier to solve). Walk us through each of these.
Topic 4 - As I was reading this book, the thing that jumped out at me the most was the importance of alignment between problem scope, how teams or individuals were aligned, and how much flexibility could be given to different parts of the problem/solution.
Topic 5 - The Phoenix and Unicorn Projects inspired a generation of IT professionals to be the champion of the change in their organization. What feedback have you gotten from the readers of Wiring the Winning Organization so far?
Topic 6 - These days everyone wants learnings to be quick and with immediate results. Is there a TikTok version of the learnings from this book that anyone could use immediately?
FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Technology Shifts vs. Drifts Jan 21, 2024

Show notes

Lots of trends happen in technology, but which ones of them are significant changes vs. just adjacencies to previous trends. Let’s explore technology shifts vs. drifts.

SHOW: 788

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Datadog Security Solution: Modern Monitoring and Security
Start investigating security threats before it affects your customers with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE

SHOW NOTES:

WHAT IS A SHIFT AND WHAT IS A DRIFT?

What is a Shift? What is a Drift?
Does it obviously help you save money?
Does it obviously help you make money?
Does it just seem to replace something else in a new way?

HOW IMPORTANT IS OBVIOUS ECONOMIC IMPACT?

Is “We can respond to the business faster” just code for “We’re not sure what the impact will be?” How many new ideas happen per year?
Why aren’t TCO or ROI more obvious with every new technology?
Mainframe (shift), Mini (drift), PC (drift?), Mobile (drift?), Virtualization (shift), Serverless (drift), Kubernetes (drift), AI (shift)
The shift vs. drift is sometimes dependent on the user/use-case

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @cloudcastpod
Instagram: @cloudcastpod
TikTok: @cloudcastpod

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Our TOPPODCAST Picks

Follow Us

Stay Connected

Related Podcasts

Links

Stay Connected