DataPlane is a high-performance software written in Golang, featuring a drag-drop data pipeline builder, built-in Python code editor, granular permissions for team collaboration, secrets management, a scheduler with multiple time zone support, and isolated environments for development, testing, and deployment.
It also allows monitoring of real-time resource usage, distributed computing with worker groups, adding more replicas for high availability and scale, and is cloud-native.
Features
Simple setup
Extremely Fast
Developer friendly
Comes with a user-friendly drag and drop pipeline manager and editor
Schedule with multiple timeline zone support
Minimal low memory and CPU footprint
Comes with a built-in Python code editor
Better queue management
Granular permissions for teams to collaborate with segregated access
⭐️ Distributed computing with worker groups.
Secrets management with logging redaction allows team members to use secure resources without revealing passwords.
Easy to install and configure using Google.
Tech Stack
The app is a cloud based app that is written using Goland and React for a frontend.
Install
To install the app you are required to have Docker and Docker Compose installed at your system. When ready, you can download the Docker-compose.yml file and run it using the following command:
curl -LfO 'https://raw.githubusercontent.com/dataplane-app/dataplane/main/quick-start/docker-compose.yaml'
docker-compose up
License
The project published in this git repo is released under the Source Available License - Business Source License 1.1 (BSL). The license was chosen to discourage cloud providers offering this project as a data platform service.
Welcome to our article about the best open-source self-hosted tools for data scientist and engineers. In this fascinating world of data, having the right tools at your disposal is crucial.
From data cleaning to visualization, these open-source tools can make your life easier and enhance your workflow.
10 Reasons Why
If you're a data engineer or data scientist, you understand the importance of a robust data observability tool. Enter Elementary, a native data observability solution designed specifically for data and analytics engineers.
It's not just a tool, it's a comprehensive platform that integrates seamlessly
Apache Superset stands as a premier open-source data exploration and visualization platform, ingeniously designed to facilitate the creation of dynamic, insightful dashboards. It is a must-have tool for data scientists, data engineers, teams and business intelligence experts.
Built for Data Exploration
It effortlessly empowers users to navigate data from diverse
What is Ipyvolume?
Ipyvolume is an innovative application designed for 3D plotting in Python, specifically within the Jupyter notebook environment. Using WebGL and IPython widgets, it provides a robust platform for visualizing complex data in three dimensions. Its capabilities include volume rendering, scatter plots, quiver plots, isosurface rendering, and lasso
Welcome to an exhaustive list of over 30 data visualization libraries, frameworks, and applications. These tools span across a myriad of platforms and programming languages, providing you with the capability to present complex data in visually appealing and accessible ways.
These solutions cater to a wide range of needs, whether
What is Image annotation and labeling?
Image annotation and labeling involves adding metadata to images, such as tags or notes, to provide additional context or meaning. This process is crucial in various fields, particularly in machine learning and artificial intelligence (AI), where it helps in training models to recognize and
What is Text annotation?
Text annotation is the process of associating labels or tags to specific parts of a text, such as phrases, words, or sentences. The aim is to provide additional information about the text, which can then be used for further analysis or processing, particularly in the field