Aug 04, 2021

New feature: sharing Data Sources across workspaces

From now on, Data Sources can be shared in a read-only way across multiple workspaces. Maintaining only one ingestion process, data can be made available for...
Tinybird
Team

We implemented workspaces to enable our customers to work on several different Data projects and/or to setup different working environments. Soon after, however, our customers started to ask about the possibility of sharing Data Sources across workspaces. The two main scenarios we’ve seen are:

  • Teams who want to re-use data across different data projects (Real-time dashboards, Alerts…) or environments (Staging, Production…) in order to avoid having to re-ingest the same data twice. Especially important for big Data Sources and Data Sources that are transformed or materialized in specific ways.
  • Teams who want to separate responsibilities, so only part of the members are responsible for ingesting and maintaining data and others can exploit it.

Starting today, sharing Data Sources across workspaces in a read-only way is possible with Tinybird.

With this feature you will be able to:

  • Share Data Sources across workspaces one-by-one and in read-only mode (Shared Data Sources can’t be re-shared). A user can only share a Data Source with other workspaces she has access to, by entering the Workspace name or its ID.
You can share Data Sources with all the workspaces you're a member of
You can share Data Sources with all the workspaces you're a member of
  • If in the origin Workspace, see which Data Sources are shared with who.
This is how a shared Data Source looks, from the workspaces that owns it
This is how a shared Data Source looks, from the workspaces that owns it
  • Log sharing activity. Who, what, when, with who.
  • Use the workspace name as a namespace for the shared Data Sources, to ensure the right Data Source is used if there are name collisions.
  • Create Pipes or Materialized Views originating from shared Data Sources.
  • If in the destination Workspace, browse shared Data Sources using a specific visual language.
Shared Data Sources have a special icon, visible both in the lateral bar as well as in the Data Flow graph
Shared Data Sources have a special icon, visible both in the lateral bar as well as in the Data Flow graph

Caveats

  • When sharing a Data Source with a Workspace, we will notify the users of the destination Workspace by email.
  • When renaming / deleting a shared Data Source from the origin Workspace, we will notify all users in workspaces where the Data Source is shared.
  • Data Sources can’t be shared using the CLI, for now. But we will display when we list the Data Sources if any of them is being shared.
  • Users that have access to a shared Data Source will have access to the tinybird.datasources_ops_log and the tinybird.kafka_ops_log Data Sources. It is important to provide as much information as possible to any customer who has access to the original Data Source.
Read-only users can also query the tinybird.datasources_ops_log Data Source of a shared Data Source
Read-only users can also query the tinybird.datasources_ops_log Data Source of a shared Data Source
  • It’s not possible for read-only users to check the quarantine of a Data Source. Having rows in quarantine is an ingestion problem, so the customer who has read access shouldn’t be worried about that, only about the “real” content.

Would you like to check out this new feature? Go to your account now.

Do you like this post?

Related posts

Build real-time analytics APIs collaboratively using Tinybird
Multi-tenant analytics for SaaS applications
Product design: how our SaaS integrates with git
DataOps: 10 principles to develop data intensive projects
More Data, More Apps: Improving data ingestion in Tinybird
A new way to create intermediate Data Sources in Tinybird
Tinybird
Team
Jun 15, 2023
DataOps: How to Develop and Scale Data Intensive Projects
Simplifying event sourcing with scheduled data snapshots in Tinybird
Changelog #17: Guided tour, Kafka ingestion improvements and more
Tinybird
Team
Dec 13, 2021

Build fast data products, faster.

Try Tinybird and bring your data sources together and enable engineers to build with data in minutes. No credit card required, free to get started.
Need more? Contact sales for Enterprise support.