AWS for Software Companies Podcast

Latest Episodes:

Ep067: Market Trends in the Software Industry with Jonathan Shulman, Senior Partner with McKinsey and Company Dec 03, 2024

Show notes

Jonathan Shulman, Senior Partner at McKinsey & Company, highlights the transformative potential of AI in the software industry and the evolutions needed to capture emerging market opportunities.

Topics Include:

AI's transformative potential in the software industry.
Why AI is a massive business opportunity.
Software industry evolution: Mainframe to Cloud SaaS eras.
Potential entrance into a new AI-driven era.
AI spend forecast: $15B to $200B by 2026.
Most AI spend repurposed from existing IT budgets.
Legacy software spend likely shifting towards AI.
Importance of targeting specific, high-impact AI use cases.
Key areas disrupted: sales, marketing, software engineering.
AI's adoption rates vary by industry and function.
Four waves of AI: predictive to agent-based.
Most companies are still in early AI stages.
Prioritize building agentic, end-to-end AI solutions.
Winning companies invest disproportionately in AI innovation.
Position offerings to tap into AI-specific budgets.
Deliver complete workflows, not isolated point solutions.
Generative AI accelerates development and iteration cycles.
Scaling AI pilots remains a major industry challenge.
Tool fragmentation undermines productivity and innovation.
Change management critical for successful AI integration.
Rethinking team roles and processes for AI deployment.
Consumption-based pricing models gaining industry traction.
Shift from perpetual to subscription to consumption models.
Balancing value-driven and cost-efficient consumption pricing.
AI market poised to redefine IT and business landscapes.

Participants:

Jonathan Shulman – Senior Partner, McKinsey and Company

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep066: Local to Global: Empowering European Software Leaders with Boardwave Nov 28, 2024

Show notes

AWS's Miguel Álava and BoardWave's Phill Robinson explore how European software companies can overcome market fragmentation, leverage cloud and generative AI, and adopt global strategies to scale competitively.

Topics Include:

Introduction of Miguel Álava and Phill Robinson
Overview of BoardWave's mission and community
Challenges for European software companies in scaling globally
Comparison of US and European software market dynamics
Cloud adoption benefits for European software scalability
Modern licensing models to centralize operations in Europe
Impact of fragmented European markets on growth
COVID-19's effect on sales strategies and efficiency
Selling enterprise software across Europe via cloud tools
Role of centralized marketing in global competitiveness
Advantages of targeting the US before EMEA expansion
BoardWave's "Voyager" model for scaling internationally
Importance of solving universal versus local market problems
Using cloud infrastructure to penetrate diverse markets
Generative AI's role in product innovation and scaling
Generative AI's transformational impact on global software industry
European software companies' opportunity to lead in AI
Building a collaborative European ecosystem for innovation
Lessons from Silicon Valley's collaborative success model
BoardWave's mentoring programs for European software CEOs
AWS's support for cloud adoption and business scaling
The evolving role of Chief Product Officers (CPOs)
AI's potential to enhance cross-market product functionality
Strategic next steps for scaling European software businesses
Vision for Europe as a software superpower by 2034

Participants:

Phill Robinson – Founder, Boardwave
Miguel Alava – EMEA ISV General Manager, Amazon Web Services

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep065: Delivering Exceptional Customer Experiences Through Innovation with RingCentral and Planview Nov 26, 2024

Show notes

Richard Borstein of RingCentral and Richard Sonnenblick of Planview discuss how AI-driven innovations enhance customer and employee experiences, and unlock organizational growth through cutting-edge tools and strategies.

Topics Include:

Importance of integrated communication tools for businesses.
Challenges caused by disconnected communication platforms.
Role of data in enhancing business operations.
How RingCentral addresses communication and data integration issues.
Benefits of real-time conversational intelligence in organizations.
Leveraging AI to transform communication into actionable insights.
Unlocking customer and employee voices through AI.
How AI identifies patterns in customer interactions.
Overview of RingSense for Sales AI tool.
Real-world success story with RingSense for Sales.
Streamlining customer interactions using AI-powered analysis.
Enhancing employee productivity with AI-driven tools.
AI solutions for faster, accurate information searches.
Overview of RingCentral's Ring CX contact center solution.
Improving customer satisfaction through AI-powered call analysis.
Case study: Success with Ring CX at Worldwide Express.
Features and benefits of RingCentral Events platform.
Integrating event tech with existing customer workflows.
Personalizing events with branding and engagement tools.
PlanView’s use of AWS to drive innovation.
Solving governance challenges with PlanView’s solutions.
How generative AI accelerates productivity and decision-making.
Making every user a power user with AI.
Practical examples of generative AI in project management.
Unlocking growth with next-gen AI-driven business tools.

Participants:

Richard Bornstein - Chief Business Development Officer, RingCentral
Richard Sonnenblick Ph.D – Chief Data Scientist, Planview

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep064: Agentic Gen AI Experiences with Atlas Vector Search and Amazon Bedrock Nov 19, 2024

Show notes

Benjamin Flast, Director, Product Management at MongoDB discusses vector search capabilities, integration with AWS Bedrock, and its transformative role in enabling scalable, efficient, and AI-powered solutions.

Topics Include:

Introduction to MongoDB's vector search and AWS Bedrock
Core concepts of vectors and embeddings explained
High-dimensional space and vector similarity overview
Embedding model use in vector creation
Importance of distance functions in vector relations
Vector search uses k-nearest neighbor algorithm
Euclidean, Cosine, and Dot Product similarity functions
Applications for different similarity functions discussed
Large language models and vector search explained
Introduction to retrieval-augmented generation (RAG)
Combining external data with LLMs in RAG
MongoDB's document model for flexible data storage
MongoDB Atlas platform capabilities overview
Unified interface for MongoDB document model
Approximate nearest neighbor search for efficiency
Vector indexing in MongoDB for fast querying
Search nodes for scalable vector search processing
MongoDB AI integrations with third-party libraries
Semantic caching for efficient response retrieval
MongoDB's private link support on AWS Bedrock
Future potential of vector search and RAG applications
Example use case: Metaphor Data's data catalog
Example use case: Okta's conversational interface
Example use case: Delivery Hero product recommendations
Final takeaways on MongoDB Atlas vector search

Participants:

Benjamin Flast - Director, Product Management, MongoDB

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep063: Building Generative AI for Speed and Cost Efficiency with Druva Nov 12, 2024

Show notes

David Gildea of Druva shares their approach to building cost-effective, fast generative AI applications, focusing on cybersecurity, data protection, and the innovative use of LLMs for simplified, natural language threat detection.

Topics Include:

Introduction by Dave Gildea, VP of Product at Druva.
Focus on building generative AI applications.
Emphasis on cost and speed optimization.
Mention of Amazon's Matt Wood keynote.
AI experience with kids using "Party Rock."
Prediction: GenAI as future workplace standard.
Overview of Druva's data security platform.
Three key Druva components: protection, response, and compliance.
Druva's autonomous, rapid, and guaranteed recovery.
Benefits of Druva’s 100% SaaS platform.
Handling 7 billion backups annually.
Managing 450 petabytes across 20 global regions.
Druva’s high NPS score of 89.
Introduction to Dru Investigate AI platform.
Generative AI for cybersecurity and threat analysis.
Support for backup and security admins.
Simplified cybersecurity threat detection.
AI-based natural language query interpretation.
Historical analogy with Charles Babbage’s steam engine.
"Fail upwards" model for LLM optimization.
Using small models first, escalating to larger ones.
API security and customer data protection.
Amazon Bedrock and security guardrails.
Testing LLMs with Amazon’s new prompt evaluation tool.
Speculation on $100 billion future model costs.
Session wrap up

Participants:

· David Gildea - VP Product Generative AI, GM of CloudRanger, Druva

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep062: Amazon Q - Your Generative AI Assistant with Urmila Kukreja of Smartsheet Nov 05, 2024

Show notes

Urmila Kukreja of Smartsheet and Nick Simha of AWS discuss leveraging Amazon Q’s Retrieval-Augmented Generation (RAG) solution to enhance productivity by enabling employees to quickly access relevant information within secure, integrated workflows like Slack, improving efficiency across the organization.

Topics Include:

Introduction by Nick Simha, AWS.
Overview of Amazon Q’s role in data analytics and Gen AI.
Gen AI’s impact on productivity, ~30% improvement backed by Gartner study findings.
General productivity improvement seen across various departments.
Amazon Q’s developer code generation tool – rapid development
Gen AI and LLMs’ challenges: security, privacy, and data relevance.
Foundation models lack specific organizational knowledge by default.
Empowering Gen AI to grant system access can cause issues
Privacy concern: Sensitive data, like credit card info, can be central in data breaches
Compliance is critical for organizational reputation and data integrity.
Data integration techniques: prompt engineering, RAG, fine-tuning, custom training.
RAG (Retrieval Augmented Generation) balances cost and accuracy effectively.
Implementing RAG requires complex, resource-heavy integration steps.
Amazon Q simplifies RAG integration with "RAG as a service."
Amazon Q’s Gen AI stack overview, including Bedrock and model flexibility.
Amazon Q connects to 40+ applications, including Salesforce and ServiceNow.
Amazon Q respects existing security rules and data privacy constraints.
Plugin functionality enables backend actions directly from Amazon Q.
All configurations and permissions can be managed by administrators.
Urmila Kukreja from Smartsheet explains real-world Q implementation.
Smartsheet’s Ask Us Engineering Slack channel: origin of Q integration.
Q integration in Slack simplifies data access and user workflow.
"Ask Me" Slack bot lets employees query databases instantly.
Adoption across departments is high due to integrated workflow.
Future plans include adding data sources and personalized response features.
Session wrap up

Participants:

Urmila Kukreja – Director of Product Management, Smartsheet
Nick Simha - Solutions Architecture Leader - Data, Analytics, GenAI and Emerging ISVs, AWS

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep061: Responsible Business Innovation with Generative AI with Harold Rivas, CISO of Trellix Oct 29, 2024

Show notes

Harold Rivas – Chief Information Security Officer at Trellix, discusses the role of generative AI in cybersecurity, focusing on Trellix's adoption of AI for threat detection and model governance, while emphasizing the importance of privacy, responsible innovation, and cross-functional collaboration.

Topics Include:

Introduction to generative AI and its impact on cybersecurity
Harold’s background in financial services and cybersecurity roles
Trellix’s focus on product feedback through the Customer Zero Program
Overview of machine learning's role in anomaly detection at Trellix
Development of guided investigations to assist security operations teams
Generative AI's growing importance in cybersecurity at Trellix
Launch of Trellix WISE at the RSA Conference in 2024
Addressing the overload of security alerts with AI models
Integration of various AI models like Mistral and Anthropic
Reducing anomalies and workload for security operations teams
Importance of privacy in generative AI adoption and data governance
Challenges with GDPR and CPRA regulations in AI implementation
Focus on privacy frameworks like the NIST Privacy Framework
Need for multi-stakeholder involvement in AI governance
Discussion on model governance inspired by financial services practices
Importance of inventorying and testing AI models for security
Benefits of an AI Center of Excellence (AICOE) within organizations
Model governance in generative AI for regulatory and business outcomes
The impact of AI on labor, jobs, and decision-making processes
Addressing cyber risk and threat modeling in AI environments
The double-edged sword of AI in offensive and defensive cybersecurity
MITRE Atlas framework's role in AI-driven cybersecurity strategies
Potential negative consequences. Auto dealership hacked – Chevy Tahoe sold for $1
Importance of vulnerability management and developer training
Evolution of AI security tools and responsible use of generative AI
Collaboration, governance, and agility in AI adoption across organizations
Q&A 1: Outcomes and responsibilities an generative AI COE should have?
Q&A 2: Model governance and financial implications
Q&A 3: CISO response to model development, compliance and learning with customer data
Q&A 4: Thoughts and suggestions for rating systems for models
Q&A 5: Selecting and evaluating models
Q&A 6: Advice and experience for model deployment and technical controls
Q&A 7: Human reviewing AI responses to ensure accuracy
Q&A 8: Will AI help avoid major outages in the future?
Q&A 9: How to test and see maturity of models?
Session wrap up

Participants:

· Harold Rivas – CISO at Trellix

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep060: Strategies to Enhance Organizational Security Culture with Arctic Wolf, Docker and Illumio Oct 22, 2024

Show notes

Executive leaders from Arctic Wolf, Docker and Illumio share insights on fostering a strong security culture, balancing innovation with security, and addressing challenges in data protection and AI model development.

Topics Include:

Overview of security culture in different company teams
Importance of guidelines and secure IT infrastructure for AI models
Challenges of accessing customer data while maintaining security
Need for anonymization in early AI model development
Docker's open-source ecosystem and security integration
Dogfooding own products to ensure product reliability and trustworthiness
Illumio’s high customer trust and responsibility for strong security practices
Balancing security awareness with development speed at Illumio
Gamifying security training to increase awareness
Interlocking with customers to enhance security understanding for developers
Embedding security into the development process from the start
Illumio's approach to security in agile, cloud-native development
Adapting customer success strategies for evolving security needs
Rise of non-developers using AI in enterprises
Educating business leaders on security best practices
Scaling customer enablement and education through community engagement
Challenges of placing security responsibilities in the developer workflow
Arctic Wolf’s AI strategy for secure development
Use of anonymized data in secure AI model training
Generative AI’s potential to augment human creativity and efficiency
Panelists' views on private AI and segmented model development
Measuring security culture progress with gamification and development metrics
Addressing human factors in cybersecurity and social engineering threats
Emphasizing resiliency and containment in preventing widespread cyberattacks.

Participants:

Dean Teffer – Vice President of Artificial Intelligence, Arctic Wolf
Dixie Dunn – VP of Customer Success, Docker
Mario Espinoza – Chief Product Officer, Illumio
Brian Shadpour – General Manager, AWS

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep059: Business Applications Transforming Industries with Cohere, Epiq and Forcura Oct 16, 2024

Show notes

Hear the generative AI journeys of Cohere, Epiq, and Forcura, including their market assessments, use case prioritization, responses to ethical and security considerations, while discussing generative AI's impact on healthcare, legal industries, and business applications.

Topics Include:

Panel Introductions by David Cristini
Where is Focura at in their AI journey
Summary of Epiq’s AI journey to date
Cohere’s AI journey to date
Where did each company begin and assessing the market opportunities
Prioritizing of use cases for Epiq
Focura’s quick focus and results with generative AI
Simplifying healthcare and improving patient experience with generative AI
How do experiments and proof of concepts develop into production?
Indicators that Cohere uses to identify customers ready to move fast
Usecases that allows Forcura customers to move forward
Guidance on engaging the Executive Team – getting Executive alignment
How are legal and healthcare customers responding to AI solutions and challenges
Changes of priority from customer advisory panels
Evolving questions and concerns of functionality and data
Some customers reporting AI evaluation is slowing them down
Usecases that are easier to start off with to gain trust and traction
Dealing with AI concerns of ethics, security and privacy – managing objections
Understanding ethics concerns – privacy can often be about where data resides
Customers often want “traceability”
Accuracy and reducing hallucinations – AI comes with risk, business have to decide on business risk
Future facing – what are we excited about?
Generative AI is excellent at translation services – ROI is excellent
Business applications and social impact of generative AI

Participants:

MaryAnn Wofford – VP of Sales, Cohere
Paul O'Hagan - Senior Director Product Management – AI Platform, Epiq
Annie Mueller Erstling – COO, Forcura
David Cristini - Director, ISV Sales North America, AWS

See how Amazon Web Services gives you the freedom to migrate, innovate, and scale your software company at https://aws.amazon.com/isv/

Ep058: Boost Employee Productivity with AI agents powered by Amazon Q Oct 08, 2024

Show notes

J.B. Brown, VP of Engineering at Smartsheet, shares how integrating Amazon Q with Smartsheet's flexible work management platform has streamlined productivity and enhanced employee support through AI-driven automation.

Topics Include: