We’re excited to announce the Basic Availability of Lakeflow Join for Salesforce and Workday. Lakeflow Join introduces no-code ingestion connectors for in style SaaS functions, databases, and file sources—enabling you to construct scalable ingestion pipelines and unlock the complete energy of your information with the Databricks Information Intelligence Platform. The Salesforce and Workday connectors are the primary managed connectors to be launched to GA because the Lakeflow Join announcement final July, with many extra on the way in which.
Lakeflow Join’s managed information connectors are powered by serverless compute and can be found throughout AWS, Azure and GCP. They’re totally built-in with the Information Intelligence Platform for governance, observability and enterprise safety.
Lakeflow Join is the primary of three elements launched as a part of Lakeflow, the unified engineering answer for ingestion, transformation and orchestration. It really works seamlessly with DLT for transformation and Databricks Workflows for orchestration.
Early adopters like Porsche Holding, Insulet, Equiniti, Stroër SE & Co. and Flick are already utilizing Lakeflow Join to resolve a few of their hardest information challenges.
Information silos trigger ingestion complexity, inefficiency
At this time, it’s tough to construct and keep ingestion pipelines for SaaS functions your self as a result of every API is exclusive and adjustments usually. In the meantime, database ingestion could be much more complicated, usually requiring further infrastructure akin to digital machines for extraction instruments, Kafka for streaming, and a robust understanding of change information seize (CDC) applied sciences for environment friendly ingestion.
Consequently, organizations spend plenty of time constructing, optimizing, and sustaining a patchwork of pipelines. This slows down initiatives and may create a fragmented ETL structure that’s tough to manipulate. It additionally forces extremely expert information engineers to spend time shifting information and monitoring pipelines as an alternative of creating strategic improvements.
Constructed-in information ingestion help for Salesforce and Workday
Lakeflow Join eliminates these challenges by making it simple to create production-ready pipelines with a number of clicks within the UI or a number of traces of code. Below the hood, ingestion is environment friendly, with incremental updates and optimized API utilization. As your managed pipelines run, we care for schema evolution, seamless third-party API upgrades, and complete observability with built-in alerts.
“With the Salesforce connector, we efficiently decommissioned 4 providers, which considerably streamlined our tech stack and lowered our prices. This integration not solely simplified our structure but additionally improved our operational effectivity, permitting us to give attention to delivering extra worth with fewer assets.”
— Simon Salmeri, Head of Information Platform, Ströer
Lakeflow Join for Salesforce means that you can pair Databricks’ superior analytics and AI instruments with Salesforce’s CRM information to construct a more practical vendor expertise: predicting gross sales tendencies, deepening insights into buyer behaviors, and personalizing engagement methods. The connector helps Salesforce-specific necessities, like customized objects and system fields.
“We’ve got been utilizing the Lakeflow Join Salesforce connector for a advertising and marketing segmentation use case. Our Salesforce information holds essential details about our clients, and the connector has been the lacking piece to deliver this dataset into our lakehouse.… We are actually at only the start of understanding our clients higher and bettering their expertise.”
— Ana-Maria Mocanu, Information and Insights Lead, Flick
Databricks and Salesforce introduced a strategic partnership in 2023 to construct sturdy integrations for our joint clients. Since then, we launched the zero-copy Salesforce Information Cloud Connector so clients can uncover, question, and govern Salesforce Information Cloud instantly from Unity Catalog. Paired with Lakeflow Join for Salesforce, clients can use each their CRM information and their CDP information inside Databricks.
Lakeflow Join for Workday additionally gives easy, low-maintenance ingestion. You’ll be able to entry customized Workday experiences for centralized analytics in your worker workforce.
Each connectors seamlessly combine with the Information Intelligence Platform, so you need to use:
- DLT to remodel information declaratively and replace transformations incrementally as information continues to stream in
- Databricks Workflows to orchestrate these pipelines
- Databricks Asset Bundles (DABs) to handle steady integration and supply
- Superior analytics and machine studying instruments to drive enterprise worth
- Unity Catalog to manipulate your information and pipelines
- Lakehouse Monitoring to keep up the standard of your information
Driving high-value enterprise use circumstances
Lakeflow Join helps unlock high-value use circumstances throughout numerous industries, akin to understanding buyer conduct, analyzing HR information, or figuring out upsell alternatives.
A standard use case is predicting buyer churn. Within the video beneath, we show how a retailer can do that by ingesting Salesforce buyer order information and mixing it with buyer interactions throughout different channels for enriched insights.
Demo: Easy methods to use Lakeflow Join for Salesforce to foretell buyer churn.
One other use case is making a buyer help dashboard for executives and help groups. You’ll be able to even use LLMs to diagnose the tendencies that seem within the dashboard, as proven in this step-by-step weblog publish.
For human assets departments, the Workday connector will help observe and predict HR tendencies, akin to worker turnover. For instance, you possibly can ingest related Workday experiences, remodel them with DLT, and incorporate the outcomes into an AI/BI dashboard.
Tons of of shoppers utilizing Lakeflow Join
Prospects are already ingesting information from a wide range of sources with Lakeflow Join.
As one of many world’s most profitable automotive firms, Porsche Holding Salzburg (Porsche) is Europe’s largest automotive retail firm with operations in 23 international locations. Porsche needed to deal with their information integration challenges and streamline entry to their buyer information in Salesforce Gross sales Cloud. Utilizing Lakeflow Join, Porsche was capable of ingest information from Salesforce, remodel it in batch and streaming modes, and deploy and function the pipelines in manufacturing. At this time, the Databricks Information Intelligence Platform varieties the core of the Porsche group’s Information Platform. Study extra about Porsche’s success utilizing Lakeflow Join.
“Utilizing the Salesforce connector from Lakeflow Join helps us shut a essential hole for Porsche from the enterprise aspect on ease of use and value. On the client aspect, we’re capable of create a totally new buyer expertise that strengthens the bond between Porsche and the client with a unified and never fragmented buyer journey.”
— Lucas Salzburger, Mission Supervisor, Porsche Holding
Insulet is a medical gadget firm that developed the Omnipod product platform, and so they had been an early adopter of Lakeflow Join. With a mission to simplify life for folks with diabetes and different situations, they sought to faucet into their CRM insights to raised perceive their buyer wants. They used the Salesforce connector to scale back their ETL latency from days to minutes—bettering the decision course of for his or her clients with close to real-time insights.
“The LakeFlow Join’s Salesforce connector was particularly vital because it allowed us to instantly ingest buyer suggestions, gross sales information and repair interactions from the Salesforce CRM into Databricks. LakeFlow Join utterly modified how we deal with Salesforce information. We removed unreliable middleware and may now analyze the whole lot instantly in Databricks – quicker and with much less handbook effort.”
— Invoice Whiteley, Senior Director of AI, Analytics and Superior Algorithms, Insulet
Equiniti (EQ) is a world chief in shareholder, pension, and remediation providers, and so they needed to centralize information and insights into their operations. Utilizing Lakeflow Join for Salesforce, Workday, and SQL Server, EQ seamlessly solved for ingestion—thus liberating up essential engineering expertise to give attention to utilizing Mosaic AI to boost the client expertise for his or her 6,000 firms throughout 136 international locations. For EQ, the power to seamlessly create no-code integrations to their core platforms helped them save time and extra prices, letting them give attention to worth multipliers like Gen AI functions. Learn the way EQ constructed a safe and unified information and AI platform in three steps.
Getting began with Lakeflow Join
Information groups can now use Lakeflow Hook up with construct environment friendly, incremental pipelines at scale, with just some clicks or traces of code. Get began at present with the Salesforce or Workday connector to assist unlock high-value use circumstances, akin to predicting buyer churn, working customized buyer analytics, and figuring out upsell alternatives.
Lakeflow Join’s roadmap contains extra connectors like SQL Server, Google Analytics, ServiceNow, SFTP, SharePoint, and PostgreSQL. Keep tuned for extra bulletins this 12 months, or attain out to your Databricks account workforce in case you’re concerned about becoming a member of a preview for early entry.
Lakeflow Join has a compute-based pricing mannequin. Salesforce and Workday, which run solely on serverless infrastructure will incur serverless DLT DBT prices. See extra particulars on charges.
To get began with Lakeflow Join for Salesforce and Workday, you possibly can overview the documentation or attempt this answer accelerator.