The Enterprise AI Show

Latest Episodes:

Streaming alternatives to Kafka Aug 23, 2023

Show notes

Yaniv Ben Hemo (@yanivbh1, Founder/CEO at @memphis_Dev) talks about Memphis Cloud, an alternative architecture to delivering streaming data for applications.

SHOW: 747

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app
CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage

SHOW NOTES:

Memphis.dev (homepage)
Getting Started with Memphis (docs page)
Apache Kafka vs. Memphis
Memphis on GitHub

Topic 1 - Welcome to the show. Tell us a little bit about your background, and what brought you to create Memphis.Dev

Topic 2 - Let’s start at the beginning. Most folks will want to know why a streaming alternative. Isn’t Kafka good enough? What challenges did you personally encounter?

Topic 3 - In reviewing the architecture, it mentions differences between a broker and a streaming stack. Can you elaborate on what that means? What components are typically needed for a proper data streaming solution?

Topic 4 - One of the common issues with Kafka I hear about is operations complexity over time. It isn’t uncommon that the more a system scales, the more complex it is to operate and also maybe the harder it is to get insights and mine for key data for instance. Have you seen this in your experience?

Topic 5 - Let’s talk use cases. How do you envision organizations using Memphis Cloud? What problems are you trying to solve in the market? Is Memphis Cloud a SaaS offering? How would it be implemented in an organization?

Topic 6 - The data management side of all of this to always be problematic. Where and how is the data managed? What does the lifecycle of the data look like and what design considerations went into this aspect?

Topic 7 - When building large distributed streaming systems, I’m sure there are trade offs and optimizations of features to consider. What are you optimizing for and what are the design tradeoffs developers need to consider?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

What is AWS after crossing the Chasm? Aug 20, 2023

Show notes

As the competitive cloud landscape is shifting, let’s take a look at some possibilities of what AWS might look like after they cross the chasm.

SHOW: 746

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE
AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage
Datadog Application Monitoring: Modern Application Performance Monitoring
Get started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.

SHOW NOTES:

3 Steps into a 10k race (Episode 428 on Software Defined Talk)
There’s no AI without the cloud (AWS CEO Adam Selipsky) - Decoder podcast
What comes after Zoom? (Benedict Evans)
Crossing the Chasm - Geoffrey Moore
Looking at Cloud hyperscaler CAPEX spending in Q2 2023 (Charles Fitzgerald)
Amazon has over half of all ARM servers (The Register)

IF ONLY 10-15% OF APPS ARE IN THE CLOUD, HAVE WE CROSSED THE CHASM?

AWS is $85B/yr business, after 17 years
AWS claims that 10-15% of IT is in the cloud
AWS has attracted startups, and mostly competes against legacy IT companies

AWS MOATS AND WHAT MIGHT COME NEXT?

Amazon/AWS has always made large CAPEX investments
AWS claims to have the largest farm of GPUs, and ARM servers
Open source projects are moving to licensing that reduces competition from AWS
AWS growth rate has been slowing since Q4 2021
Innovation? Application Portfolio? Pricing vs. Profitability?
AWS has done limited acquisitions and partners are kept at arms-length (vs. OpenAI / MSFT)
AWS seems to be behind in the AI race, although still very early in the market maturity
AWS doesn’t have a large set of “owned/branded” applications
What does a future AWS look like that is mostly infrastructure?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Understanding Machine Learning Features and Platforms Aug 16, 2023

Show notes

Gaetan Castelein (@gaetcast, VP Marketing at @tectonai) talks about the complexities of building AI models, features and deploying AI into production for real-time applications.

SHOW: 745

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE
Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app

SHOW NOTES:

Tecton (homepage)
State of Applied Machine Learning 2023 Report
Hello Fresh adopts Tecton - Good article on features and feature stores
What is real-time machine learning?
Feature Platform vs. Feature Store

Topic 1 - Welcome to the show. Tell us a little bit about your background

Topic 2 - Let’s start with some terminology. A lot of our listeners might be relatively new to Machine Learning. I’m still coming up to speed and I actually spent more time than usual just wrapping my head around the concepts and terms and piecing them all together. What is a feature? Why is it important? How many features does ChatGPT 3 have or ChatGPT4?

Topic 3 - How is a feature different from a model? Both are needed, why?

Topic 4 - I’ve always wondered exactly what a data scientist does. Is this where the term Feature Engineering comes into play? Who turns the data into features and picks the appropriate model?

Topic 5 - Early Machine Learning was analytical ML (offline/batch), correct? How is that different from operational ML (online/batch) and real-time ML?

Topic 6 - Now that we have all that out of the way. What is a Feature Platform? How does it integrate into an organization’s existing Devops workflows and/or CI/CD pipelines? (Features as Code) How is it different from a Feature Store?

Topic 7 - How do you know if the features + model yield a good result? How is prediction accuracy typically measured?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Cloud and Software Economics Aug 13, 2023

Show notes

If every company has become a software company, is it still easy to be a profitable software company? Lots of things are changing around the economics of software.

SHOW: 744

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Datadog Application Monitoring: Modern Application Performance Monitoring
Get started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.
CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend

SHOW NOTES:

BEING A SOFTWARE COMPANY - JUST BUILD A MOAT

Are we sure every company wants to become a software company?
Lots of software licensing changes in the news
Making money as a software business, at scale, is difficult

PEOPLE DON’T LIKE MOATS AROUND THEIR SOFTWARE

Open source is good for collaboration
Open source could be good for marketing
Software margins attract VCs
Open source mostly hates software margins
What happens to all the software companies funded by VCs over the last 3 yrs?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Trends in API Security Aug 09, 2023

Show notes

Filip Verloy (@filipv, Field CTO at @NonameSecurity) talks about the latest trends in API security, how you could be a victim of a Moveit attack, and more

SHOW: 743

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE

SHOW NOTES:

Topic 1 - Welcome to the show. We’ve worked together in the past at previous companies, it’s great to catch up again. For those out there that don’t know you, tell us a little bit about your background, and how you got involved in API security.

Topic 2 - We keep hearing about APIs and API security but in a roundabout way. We hear on tech news that data has been leaked, customer accounts and info got out. There have been many high profile, well known instances. What often isn’t reported is the way in which the breaches happen. More times than not it is API’s and improper security, correct?

Topic 3 - What are the most common problems you see in organizations? What problems do folks bring you in to solve? Why isn’t a WAF (web application firewall) enough?

Topic 4 - Security, no matter the type, can be a tough sell sometimes. It’s hard to do an ROI on something that hasn’t happened for instance. What are your thoughts on this?

Topic 5 - As a followup, who is the audience that has the budget? CISO’s don’t typically come from a developer background, true?

Topic 6 - What are the typical steps on a journey towards securing APIs. Where do most folks start (assuming nothing, maybe a WAF at best) and how far does it go. Identification, automated remediation, etc.

Topic 7 - It seems every industry is being impacted in some way by AI/ML. How do you see this playing a role in the future of API security?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

The PizzaHut and TacoBell of Platforms Aug 06, 2023

Show notes

Does it ever feel like all the technologies are just things layered on top of each other? Does it ever feel like platforms are a combination of Pizza Hut and Taco Bell?

SHOW: 742

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

GCore - Global Hosting, CDN, Edge and Cloud Services
Use promocode “CLOUDCAST” to receive a €100 credit on Gcore services
CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
Datadog Application Monitoring: Modern Application Performance Monitoring
Get started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.

SHOW NOTES:

WHEN EVERYTHING IS A PLATFORM, FOR PLATFORM ENGINEERING TEAMS

Is everything really now on the shoulders of the Platform Engineering team?
Are all platform engineering teams all combined together?

BE CAREFUL ABOUT CREATING THINGS WITH NO MEANING

“It still stands as the best summary of the state of living we call Now imaginable. No business or brand means anything, no meaning cannot be bundled for the purpose of the sales team, nothing is too special that it can’t be balled up into a late night chaos meal thrown straight into the mouth of drunken capitalism.” - Holly Anderson and Spencer Hall, Channel 6

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

What's Happening with SuperCloud? Aug 02, 2023

Show notes

Dave Vellante (@dvellante, Cofounder & Co-CEO SiliconANGLE Media, co-host of @theCUBE) gives an update on the status of SuperClouds and talks about the recent SuperCloud 3 event.

SHOW: 741

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

GCore - Global Hosting, CDN, Edge and Cloud Services
Use promocode “CLOUDCAST” to receive a €100 credit on Gcore services
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE
Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app

SHOW NOTES:

2022 Look Ahead to SuperClouds (Cloudcast Eps.586)
SuperCloud 3 (event)
SuperCloud 2 (event)
The Rise of SuperCloud (2021)
theCUBE (homepage)

Topic 1 - Welcome back to the show. You cover everything, but where are your main focuses these days?

Topic 2 - For anyone that’s new to Cloudcast, or new to this concept of SuperCloud (which has evolved over time), give us the high-level overview of the concept.

Topic 3 - Let’s dive right into SuperCloud, since you just finished the SuperCloud 3 event. What were the big trends within the event?

Topic 4 - The new focus on AI seems to have shown a new light on the location of data, and how well isolated data (and models) are from other companies. How do you see the concept of SuperCloud playing with new AI demands around data locality?

Topic 5 - It seems like nobody is going to be able to afford the CAPEX required to do AI (GPUs) at scale except the big three hyperclouds. They are all going through various levels of economic challenges. Do you expect to see infrastructure becoming an AI bottleneck soon?

Topic 6 - Are you seeing any companies or technologies breaking away from the pack with regard to the SuperCloud capabilities?

Topic 7 - Where are you focusing on the next SuperCloud event and research?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

The Future of Software? Jul 30, 2023

Show notes

What does the future of the software business look like? How much of an impact will SaaS and AI have on the profitability of software?

SHOW: 740

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app

SHOW NOTES:

Are Software Companies Bad Business? - Clouded Judgment
Aggregation Theory - Stratechery

SOME VCs ARE QUESTIONING IF SOFTWARE IS A GOOD BUSINESS

VCs are concerned about the rate of return (and cash-flow) or software.
Is the future of open source software always SaaS offerings? Have we seen enough success with that model to say it’s a viable future business model?

WHAT ARE THE EVOLVING DYNAMICS OF THE SOFTWARE BUSINESS?

Is SaaS too fragmented, or will aggregated platforms emerge?
How much will AI add to the costs (or COGS) of software?
If software (especially SaaS) is bought by end-users or teams, will they appreciate AI automation vs. concern about jobs?
How does the pricing of SaaS evolve? Is it still per-seat, if AI can reduce the number of seats?
Are there channels for PLG software?
If every company is a software company, is software becoming a commodity?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Building Large AI Models Jul 26, 2023

Show notes

Dr. Ronen Dar (Co-Founder/ CTO of @runailabs) talks about the challenges of running compute infrastructure for AI, the GPU ecosystem, sizing LLMs and more.

SHOW: 739

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

GCore - Global Hosting, CDN, Edge and Cloud Services
Use promocode “CLOUDCAST” to receive a €100 credit on Gcore services
Equinix Global Data Centers and Networking
Learn more and signup at https://deploy.equinix.com/. Use the coupon code CLOUDCAST to get $500 in credits to get started.
Datadog Kubernetes Solution: Maximum Visibility into Container Environments
Start monitoring the health and performance of your container environment with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.

SHOW NOTES:

Run:ai - Build Your Next Large Model (homepage)
Ronen Dar, Run:AI's CTO, on managing computation resources in ML pipelines

Topic 1 - Welcome to the show. Tell us a little bit about your background, and what you focus on at Run:ai.

Topic 2 - Let’s begin by talking about the challenges of running AI applications. What unique characteristics and requirements do AI applications have?

Topic 3 - Most AI applications run on GPUs. How do things change when using GPUs vs. CPUs to power AI applications? What is needed to get the most out of GPUs?

Topic 4 - As environments grow larger, what is needed to scale-up environments, both in terms of scheduling applications and managing the underlying GPU infrastructure?

Topic 5 - GPUs are not only expensive resources, but also in high-demand. How are companies doing capacity planning with GPUs? What struggles are you seeing companies have as they manage planning for AI projects?

Topic 6 - Are the new Large Language Models (LLMs) much different in size than AI models of the past?

Topic 7 - How well is the industry prepared to deal with the new interest in AI from across the industry?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Free or Fee is Often Complicated Jul 23, 2023

Show notes

Some recent events in the tech industry have questioned the spirit of open source, the value of contributions, and the standards that various entities should be held to. This is not a new concept, and it’s often complicated.

SHOW: 738

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

GCore - Global Hosting, CDN, Edge and Cloud Services
Use promocode “CLOUDCAST” to receive a €100 credit on Gcore services
Equinix Global Data Centers and Networking
Learn more and signup at https://deploy.equinix.com/. Use the coupon code CLOUDCAST to get $500 in credits to get started.
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE

SHOW NOTES:

Meta’s LLAMA-2 is not Open Source (OSI opinion)
LLAMA-2 doesn’t fit the definition of open source (Twitter)
Are Software Companies Bad Businesses? (Clouded Judgment)
John Rockefeller Jr. and Grand Teton National Park
Grand Tetons National Park (Wyoming, USA)
History of Standard Oil, Trusts and Monopolies

THE TECH WORLD HAS A STRANGE RELATIONSHIP WITH FREE

This past week I didn’t think about tech very often
But coincidentally the world I was in had a historic overlap with some discussions in the tech world.

FREE IS GOOD RIGHT? WHAT ABOUT WHEN IT’S DEEMED TO BE NOT GOOD?

When do we determine that free is a good thing or a bad thing?
When do we determine that work or contributions are valuable? Or invaluable?
Are there always good actors and bad actors when something of value is involved?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Our TOPPODCAST Picks

Follow Us

Stay Connected

Related Podcasts

Links

Stay Connected