Coming soon: A Perfect Synergy Between Data Integration Technology and Vector Databases! The SeaTunnel community is thrilled to team up with the Milvus vector database community for an exclusive online Meetup!

Event Organizer | Debra Chen

Background

Apache SeaTunnel, a high-performance data integration and synchronization tool, has long been a key player in the big data space. Milvus, a leading open-source vector database, focuses on advancing vector data management and AI applications.

In its latest release, SeaTunnel Connector has officially added support for the vector database Milvus—an important milestone in SeaTunnel’s mission to enhance AI application development efficiency. SeaTunnel will continue to support more vector databases, deepening its integration with the AI ecosystem and providing users with highly efficient, flexible data processing and management solutions.

On November 12, the SeaTunnel and Milvus communities will co-host an online Meetup. Engineers and architects from both open-source communities will present insightful technical discussions and application cases. This exciting technical event will showcase the numerous innovations resulting from the fusion of these two projects—don’t miss it!

Event Details

Date and Time: November 12, 2024 (Tuesday) 19:00-20:30 (Beijing Time)

Registration Link: Click to register

Event Agenda

1. The Evolution and Optimization of the Data Integration Platform at 58.com

• Speaker: Liang Zhao, Architect at 58.com Head of the Data Integration Department, responsible for Kafka, Flume, Pulsar, and data integration platform optimization and upgrades.
• Overview: This presentation will cover the development journey of 58.com’s data integration platform built on Apache SeaTunnel, including background and challenges, architectural evolution, smooth migration, performance tuning, monitoring and automated operations, as well as future outlook and planning.

1. Innovation and Practice in Vector Databases with Milvus

• Speaker: Nian Liu, Software Engineer at Milvus Focused on vector database and AI infrastructure R&D, Nian is currently working with Zilliz on deploying Zilliz Cloud on major cloud platforms such as AWS, Azure, and GCP to build a long-term memory infrastructure for LLMs. He is also involved in developing RAG systems and data pipelines related to vector databases, aiming to help enterprises quickly build AI applications.
• Overview: Managing and migrating vector data in AI application development is challenging. Traditional ETL tools like Airbyte and SeaTunnel perform well in relational databases but face limitations with vector data. To address this, we developed a new open-source migration service based on Apache SeaTunnel, incorporating extensive Milvus data migration experience and comprehensive functionality upgrades.

Double Raffle Draw!

We’re bringing back the popular raffle draws—one at the start and another at the end for survey participants! Thanks to sponsorship from WhaleOps and the Milvus community, livestream attendees will have the chance to win Apache SeaTunnel custom keychains + mask gift sets, as well as Milvus T-shirts and charger adapters. Mark your calendars and don’t miss out!