Bobur Umurzokov - Build AI-powered data pipeline without vector databases | PyData Global 2023

Build AI-powered data pipelines without vector databases using Pathway engine, combining real-time data and AI for instant feedback in applications, from PyData Global 2023.

Key takeaways
  • Building AI-powered data pipelines without vector databases is possible using the Pathway engine.
  • Real-time data and AI can be combined to provide instant feedback for applications.
  • The Pathway engine allows for real-time data processing, indexing, and querying without the need for vector databases.
  • LLMs (Large Language Models) can be used to extract insights from unstructured data, such as PDFs, Docs, and PowerPoints.
  • The Pathway engine provides a simple architecture for building AI applications, eliminating the need for complex technologies like vector databases.
  • Real-time alerting can be used for security and compliance cases, and for monitoring model performance.
  • The Pathway engine supports open-source and paid providers, such as Open AI API, and allows for customization of embeddings features.
  • The engine provides a chat GPT interface for answering questions and extracting insights from data.
  • The Pathway engine can be used to build AI applications without requiring extensive knowledge of architecture and technologies.
  • Real-time data processing and querying can be achieved using the Pathway engine, eliminating the need for batch processing and reducing latency.
  • The engine supports various data sources, including CSV files, JSON lines, PDFs, and APIs.
  • The Pathway engine provides a simple and scalable architecture for building AI applications, making it easy to integrate with existing systems and technologies.
  • The engine can be used to build applications that provide real-time insights and feedback, such as sales and discounts tracking, and employee performance monitoring.
  • The Pathway engine is supported by the Pathway community, which provides additional features and functionality.
  • The engine can be used to build applications that provide real-time alerts and notifications, such as security and compliance alerts.