The Enterprise AI Show

Latest Episodes:

Will a New Cloud Emerge? Sep 27, 2023

Show notes

Aaron Delp and Brian Gracely discuss the possibility of another major cloud provider emerging as the economy changes and new application workloads begin to take shape.

SHOW: 757

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE
Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app

SHOW NOTES:

Topic 1 - Do you remember back when AWS was starting to take off, and Simon Wardley used to talk about how IBM or HP or Cisco or EMC/VMware should have been the ones building the utility cloud services?

Topic 2 - We’re now at a stage when all anyone can talk about is AI (Generative AI, LLMs, etc.) and GPUs. So which one is more powerful, the Models/Data or the Infrastructure?

Topic 3 - Is it possible that NVIDIA could start building their own cloud? Do they potentially want to own a more vertical experience?

Topic 4 - Obviously the buildout costs are enormous, but are they that much different from what the Big 3 are trying to do in retrofitting existing data centers, or hiring to build their own mini-Nuclear reactors?

Topic 5 - Who could potentially be a partner to NVIDIA in building out this type of cloud in the near-term? (Equinix, national governments, cities-of-the-future, sovereign wealth funds, etc.)

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Every company is a Hardware company Sep 24, 2023

Show notes

What happens when every software company needs to be a hardware company first? And how are leading VC firms potentially predicting that the 2000s will be repeating themselves?

SHOW: 756

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
Datadog Application Monitoring: Modern Application Performance Monitoring
Get started monitoring service dependencies to eliminate latency and errors and enhance your users app experience with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.
AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage

SHOW NOTES:

AI’s $200B Question (Sequoia)
5 years and $15B later, a fiber venture fails (Global Crossing)
Dot com bubble
The history of Switch Data Centers
Interest rates over the last 30 years
The Cost of Cloud, A Trillion Dollar Paradox (a16z)
VCs vs the Cloud (Eps.656)

BACK IN THE DOT COM DAYS, WE ASSUMED THAT EVERYTHING WOULD BE INTERNET

Let's remember how we transitioned from the late 1990s to the early 2000s
VCs used to have a $50M "hardware tax" on investments
Cloud and Low Interest Rates changed everything
New Technology with Simple UI + Infrastructure Buildouts + Unknown Business Models

NOW WE ASSUME THAT EVERYTHING WILL BE AI (and GPUs)

Interest rates have come back up to 2001 levels
VCs are back to paying the "hardware tax", and aren't happy
New Technology with Simple UI + Infrastructure Buildouts + Unknown Business Models
Let's see if history repeats itself.

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Training and Labeling Foundational AI Models Sep 20, 2023

Show notes

Alex Ratner (@ajratner, CEO @SnorkelAI) talks about labeling and training of LLMs. We go over Foundational Models and how to take an “off the shelf” model and fine-tune it for private use.

SHOW: 755

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE

SHOW NOTES:

Topic 1 - Welcome back to the show. We last spoke two years ago. A lot has changed so we thought it would be a great time to talk about updates. For those that aren’t familiar, give everyone a quick background.

Topic 2 - Let’s start with when we last spoke. We talked a lot about data scientists and how data labeling works for training LLM’s. For those that aren’t familiar, can you give everyone a quick intro to data labeling and why it is important for training?

Topic 3 - When we last spoke, LLM weren't as mainstream as they are today. How has this impacted how you think about AI/ML in general? What are the big challenges for LLM today that you see?

Topic 4 - Many organizations are trying “off the shelf” models but this may or may not be a good idea. On one side they don’t have to build a model but on the other they still have to fine tune it to their specific needs and use case. What are your recommendations for organizations to get started and be as effective as possible?

Topic 5 - In addition to organization specific models, are teams building purpose built models for specific functions (i.e. are they running multiple models each with a different task?) How does labeling and training come into play here?

Topic 6 - Another challenge I’m seeing is security and data privacy concerns. What do folks getting started need to be aware of to make sure company data is safe?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

A Proposal for OSS Longevity Sep 17, 2023

Show notes

As OSS projects continue to look for ways to balance community, sustainability and profitability, let’s explore some alternative considerations for companies and communities.

SHOW: 754

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Datadog Synthetic Monitoring: Frontend and Backend Modern Monitoring
Ensure frontend issues don’t impair user experience by detecting user-facing issues with API and browser tests with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.
AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage
CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend

SHOW NOTES:

Troubles with Open Source Gig Economy (Chris Aniszczyk, CNCF)
Open Source Needs Maintainers, How Do They Get Paid? (TNS)
A New Way to Think about Open Source Sustainability (InfoWorld)

OPEN SOURCE HAS BECOME CRITICAL INFRASTRUCTURE FOR BUSINESSES

Docker, Kubernetes, Terraform, Ansible, Kafka, MongoDB, ElasticSearch, Java are all mission-critical to businesses.
Cloud providers have disrupted the previous OSS models - operationalize vs. contributions
How to pay contributors?
How to avoid unpredictable changes to licensing?
How to provide better transparency to customers and communities?

DO OSS PROJECT NEED MORE STRUCTURE TO SUCCEED OR SUSTAIN?

Establish “types” of projects: Business, Community, Any - Years to Action
Establish some timelines around various types of projects
Patents have a timeline to explore - can there be OSS licenses that have timelines
Government tax credits for paying OSS contributors
Should governance foundations create forks at established times?
Should groups like CNCF be more active in recruiting forks after a period of time?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Automating Developer Security and Compliance Sep 13, 2023

Show notes

Matt Spitz (@mattspitz, Head of Engineering at @TrustVanta) talks about the challenges of developer security and compliance.

SHOW: 753

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE
Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app

SHOW NOTES:

Vanta (homepage)

Topic 1 - Welcome to the show. Tell us a little bit about your background. What made you join Vanta and did your experience at Dropbox factor into this decision?

Topic 2 - Our topic today is developer security and compliance. Let’s start by helping our listeners understand the problem. We hear all the time about developers wanting to go fast. Things like security and compliance can be an afterthought. Do you agree and is this the root of the problem or is it something else?

Topic 3 - Most organizations, especially smaller orgs or startups just getting going, they just want to get to MVP, what advice to you have for them in building security and compliance into their CI/CD pipelines so this becomes more programmatic?

Topic 4 - Security is certainly one angle, but probably just as important, if not more so is compliance. To make it slightly more difficult, compliance can mean many different things based on geography (SOC in US for instance). How do organizations staff for this and keep up with regulation changes? Or, maybe on the flip side, is this a common area where they are understaffed and need outside assistance?

Topic 5 - In security and compliance worlds there is often the concept of identification and discovery as one part, but remediation as the second part. Where and how does Vanta work with organizations to solve for both vectors?

Topic 6 - Automation, especially into CI/CD pipelines seems like a no-brainer here, but I would also add is this an area where AI/ML will come into play in the future?

Topic 7 - If folks want to dig in and learn more, how do you suggest they get started?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Digital Transformation meets its Liability moment Sep 10, 2023

Show notes

As digital transformations are happening to major industries, we’ve moved into an era where legal issues could become more prevalent than the technologies.

SHOW: 752

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage
CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
Datadog Kubernetes Solution: Maximum Visibility into Container Environments
Start monitoring the health and performance of your container environment with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.

SHOW NOTES:

BREAK THE LAW NOW, AND ASK FOR FORGIVENESS LATER?

From ride-sharing to crypto to generative AI, the gray areas of the law or property ownership are at the center of the major digital transformations
The open source community is debating what is proper licensing, and should licensing ever change?
Are we at the beginning of LegalOps or LiabilityOps?

IS THE LIABILITY IN BUSINESS MODEL, IP, PRIVACY, FRAUD OR CORRUPTION

What are companies liable for? Fair-use of data? AI Models? AI recommendations? AI actions?
What laws do cloud providers need to be concerned about?
What do customers need to be concerned about?
What do systems-integrators need to be concerned about?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Updates to Infrastructure as Code Sep 06, 2023

Show notes

Joe Duffy (@funcOfJoe, Co-Founder/CEO @PulumiCorp) talks about the evolution of infrastructure as code, the challenges of multi-cloud, and applying Generative AI to Ops.
SHOW: 751

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE

SHOW NOTES:

Topic 1 - Welcome to the show. Tell us a little bit about your background. What made you found Pulumi and you have an extensive developer background at Microsoft as well.

Topic 2 - Pulumi’s been in the market for 6+ years and we first spoke 4 years ago. Has the IaC space “settled down”? Do you consider it still emerging, evolving, or mature at this point?

Topic 3 - We’re seeing a lot of organizations manage resources and infrastructure across multiple clouds. What are the big challenges of multiple vs. single clouds?

Topic 4 - Another big trend is of course Generative AI. You recently announced Pulumi Insights. Can you tell everyone about how this came to be and the problem you are trying to solve?

Topic 5 - Let’s talk about culture quickly. How do organizations, especially large organizations with many groups and tools, standardize tools and processes? What are the big hurdles that need to be overcome?

Topic 6 - OSS has been in the news lately, especially around the Terraform project. What are your thoughts on OSS and its place in IaC both today and going forward?

Topic 7 - We see you have a big webinar coming up. It looks to be a great place to dig in and get started. Tell everyone about it for those out there that want to know more.

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

The Labor Day episode about Tech Labor Sep 03, 2023

Show notes

As we celebrate Labor Day (at least in the US), a few labor-centric topics are starting to dominate the headlines - Return to Office (RTO) and AI Augmentation. Let’s discuss how they might play out.

SHOW: 750

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
Datadog Monitoring: Modern Monitoring and Analytics
Start monitoring your infrastructure, applications, logs and security in one place with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.
AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage

SHOW NOTES:

GO TO THE OFFICE, WORK FROM HOME, OR SOME SORT OF HYBRID?

Why is the RTO being pushed? (Innovation, Collaboration, Teambuilding, Cost of Buildings, etc.)
Does either side (Labor vs. Mgmt) have leverage?
How will people talk about AI-driven productivity?

AI IS PROMISING TO DRIVE PRODUCTIVITY, BUT AT WHOSE COST?

Should you go into the office?
What are the benefits of being in the office? (proximity to power, more collaboration, visibility)
Should you lean into AI augmenting or replacing a job function?
Will AI go after basic jobs, middle jobs or unique jobs?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Economics & Optimization of AI/ML Aug 30, 2023

Show notes

Luis Ceze (@luisceze, Founder/CEO @OctoML) talks about barriers to entry for AI & ML, the economics of funding, training, fine tuning, inferencing and optimizations.

SHOW: 749

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

NEW TO CLOUD? CHECK OUT - "CLOUDCAST BASICS"

SHOW SPONSORS:

CloudZero – Cloud Cost Visibility and Savings
CloudZero provides immediate and ongoing savings with 100% visibility into your total cloud spend
Reduce the complexities of protecting your workloads and applications in a multi-cloud environment. Panoptica provides comprehensive cloud workload protection integrated with API security to protect the entire application lifecycle. Learn more about Panoptica at panoptica.app

SHOW NOTES:

Topic 1 - Welcome to the show. You have an interesting background with roots in both VC markets and academia. Tell us a little bit about your background.

Topic 2 - Generative AI is now all the rage. But as more people dig into AI/ML in general, they find out quickly there are a few barriers to entry. Let’s address some of them as you have an extensive history here. The first barrier I believe most people hit is complexity. The tools to ingest data into models and deployment of models has improved but what about the challenges implementing that into production applications? How do folks overcome this first hurdle?

Topic 3 - The next hurdle I think most organizations hit is where to place the models. Where to train them, where to fine tune them and where to run them could be the same or different places. Can you talk a bit about placement of models? Also, as a follow up, how does GPU shortages play into this and can models be fine tuned to work around this?

Topic 4 - Do you see the AI/ML dependence on GPU’s continuing into the future? Will there be an abstraction layer or another technology coming that will allow the industry to move away from GPU’s from more mainstream applications?

Topic 5 - The next barrier but very related to the previous one is cost. There are some very real world tradeoffs between cost and performance when it comes to AI/ML. What cost factors need to be considered besides hardware costs? Data ingestion and data gravity comes to mind as a hidden cost that can add up quickly if not properly considered. Another one is latency. Maybe you arrive at an answer but at a slower rate that is more economical. How do organizations optimize for cost?

Topic 6 - Do most organizations tend to use an “off the shelf model” today? Maybe an open source model that they train with their private data? I would expect this to be the fastest way to production, why build your own model when the difference is in your data? How does data privacy factor into this scenario?

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Considerations for Enterprise AI Aug 27, 2023

Show notes

Let’s talk through some of the challenges that Enterprises will have with AI - from data location to GPU location, to model biases, to data privacy to training vs. execution.

SHOW: 748

CLOUD NEWS OF THE WEEK - http://bit.ly/cloudcast-cnotw

CHECK OUT OUR NEW PODCAST - "CLOUDCAST BASICS"

SHOW SPONSORS:

Datadog Security Solution: Modern Monitoring and Security
Start investigating security threats before it affects your customers with a free 14 day Datadog trial. Listeners of The Cloudcast will also receive a free Datadog T-shirt.
Find "Breaking Analysis Podcast with Dave Vellante" on Apple, Google and Spotify
Keep up to data with Enterprise Tech with theCUBE
AWS Insiders is an edgy, entertaining podcast about the services and future of cloud computing at AWS. Listen to AWS Insiders in your favorite podcast player.
Cloudfix Homepage

SHOW NOTES:

An Interview with Daniel Gross and Nat Friedman on the AI Hype Cycle (Stratechery)

ARE THERE EXPECTATIONS OF “OLD AI” vs. “NEW AI”?

Are business leaders thinking about unique AI applications and use-cases, or just “ChatGPT-everything”?
Formal data scientists vs. citizen data scientists?
Will this just be an application, or have an impact on every aspect of a business and the IT industry?

WILL ENTERPRISE AI BE DIFFERENT THAN CONSUMER AI?

The industry is actively working on a broad set of models that can be used for different use-cases.
It's commonly accepted that AI models need to be trained near the sources of data.
Many businesses are concerned about including their company data into these public models
Many businesses will want to deploy tuned models and applications in data center, public cloud and edge environments.
New AI applications will be required to meet security, regulatory and compliance standards, like other business applications.

FEEDBACK?

Email: show at the cloudcast dot net
Twitter: @thecloudcastnet

FEEDBACK?

Email: show @ the enterprise ai show dot com
Bluesky: @TheEntAIShow.bsky.social
Twitter/X: @TheEntAIShow
Instagram: @TheEntAIShow

Our TOPPODCAST Picks

Follow Us

Stay Connected

Related Podcasts

Links

Stay Connected