Unlocking Data Insights for Non-Technical Users

Introduction

• Speakers: T (Director of Product) & Andre (Staff Software Engineer at Databricks)
• Objective: Show new methods to unlock data insights for non-technical business users using Databricks apps.
• Story: Sarah (VP of Sales) vs. Dan (Data Scientist)
  • Sarah is proficient in Excel and email but lacks data handling skills.
  • Dan uses notebooks, queries, and dashboards to extract insights.

Current Data Handling Challenges

• Tools Used by Dan:
  • Notebooks and programming languages (Python, SQL)
  • Dashboards for visualization and interaction
• Limitations of Dashboards:
  • Limit interactivity for complex analysis
  • Difficult to visualize and manipulate data extensively

The Need for Custom Apps

• **Why Notebooks and Dashboards Aren’t Enough: **
  • Lack of direct interaction and data manipulation
  • Need for building applications that are more intuitive for business users
• Solution: Develop custom applications
  • Apps can cater to specific user needs and provide appropriate interaction models

Developing and Sharing Applications

• Challenges of App Development for Data Scientists:
  • Deployment and infrastructure management
  • Sharing and access control complexities
  • Compliance with IT security rules

Introduction to Databricks Custom Applications

• Features:
  • Simplified app development and deployment
  • Security compliance with organizational IT rules
  • Hosting managed by Databricks
• Benefits:
  • Use of service principles for secure authentication
  • Ability to share applications easily while maintaining access control

Demonstration by Andre

• Frameworks and Tools Used:
  • Example with Gradio for building web applications
  • Integration with Databricks using VS Code and CLI
• Key Steps in the Demo:
  • Code setup and deployment on Databricks
  • Querying data directly from Databricks
  • Error handling and debugging
• Advanced Features Shown:
  • Using process managers like Uvicorn for production
  • User authentication and token management
  • App deployment using templates

Advantages of Using Databricks for App Development

• Flexibility:
  • Supports multiple frameworks (Gradio, Streamlit, Dash)
  • Choice of development environment (local or cloud-based)
• Security and Governance:
  • Built-in security and IT compliance
  • End-to-end encryption and user-based data access
• Collaboration and Deployment:
  • Supports Git and CI/CD workflows
  • Use of Databricks assets and bundles for organization

Availability and Future Plans

• Current Status: Private preview available now
• Public Preview: Planned for later in the summer
• General Availability: Targeted by the end of the year

Contact and Feedback

• Interested users can reach out to Andre or Nick
• Opportunities to join the private preview
• QR code provided for quick sign-up

Conclusion

• The session highlights the potential for Databricks apps to bridge the gap between technical and non-technical data users, enhancing data accessibility and operational efficiency.

---

This session provides a comprehensive overview of the development, deployment, and management of custom applications using Databricks, emphasizing security, ease of use, and flexibility.