tangle

Tangle

Tangle is a service and a Web app that allows the users to build and run Machine Learning pipelines using drag and drop without having to set up development environment.

Demo

Demo

The experimental new version of the Tangle app is now available at https://cloud-pipelines.net/pipeline-studio-app . No registration is required to experiment with building pipelines. To be able to execute the pipelines, follow the installation instructions.

Please check it out and report any bugs you find using GitHub Issues.

The app is under active development, so expect some breakages as we work on the app and do not rely on the app for production.

Installation

Try on local machine

1. Install Docker and uv.
2. Download the app code (needs to be done once):

git clone https://github.com/Cloud-Pipelines/backend.git tangle/backend --branch stable
git clone https://github.com/Cloud-Pipelines/pipeline-studio-app.git tangle/frontend_build --branch gh_pages_stable --single-branch --depth 1

1. Start the app:

Linux and Mac OS:

cd tangle && backend/start_local.sh

Windows:

cd tangle && backend\start_local.cmd

1. Once the “start_local: Starting the orchestrator” message appears in the terminal, open the http://localhost:8000 URL in a Web browser and start use the app. Click the “New Pipeline” button at the top to start building a new pipeline.

Try in Google Cloud Shell (free)

Google Cloud Shell is free (50 hours per week) and needs a Google Cloud account.

1. Open Google Cloud Shell in a Web browser
2. Download the app code (needs to be done once):

git clone https://github.com/Cloud-Pipelines/backend.git tangle/backend --branch stable
git clone https://github.com/Cloud-Pipelines/pipeline-studio-app.git tangle/frontend_build --branch gh_pages_stable --single-branch --depth 1

1. Start the app:

cd tangle && backend/start_local.sh

1. Once the “start_local: Starting the orchestrator”, “View app at” messages appears in the terminal, open the https://shell.cloud.google.com/devshell/proxy?port=8000 URL in another browser tab and start using the app.

App features

• Start building pipelines right away
  • Intuitive visual drag and drop interface
  • No registration required to build. You own your data.
• Execute pipelines on your local machine or in Cloud
  • Easily install the app on local machine or deploy to cloud
  • Submit pipelines for execution with a single click.
  • Easily monitor all pipeline task executions, view the artifacts, read the logs.
• Fast iteration
  • Clone any pipeline run and get a new editable pipeline
  • Create pipeline -> Submit run -> Monitor run -> Clone run -> Edit pipeline -> Submit run …
• Automatic execution caching and reuse
  • Save time and compute. Don’t re-do what’s done
  • Successful and even running executions are re-used from cache
• Reproducibility
  • All your runs are kept forever (on your machine) - graph, logs, metadata
  • Re-run an old pipeline run with just two clicks (Clone pipeline, Submit run)
  • Containers and strict component versioning ensure reproducibility
• Pipeline Components
  • Time-proven ComponentSpec/component.yaml format
  • A library of preloaded components
  • Fast-growing public component ecosystem
  • Add your own components (public or private)
  • Easy to create your own components manually or using the Cloud Pipelines SDK
  • Components can be written in any language (Python, Shell, R, Java, C#, etc).
  • Compatible with Google Cloud Vertex AI Pipelines and Kubeflow Pipelines
  • Lots of pre-built components on GitHub: Ark-kun/pipeline_components.

We have many exciting features planned, but we want to prioritize the features based on the user feedback.

Credits:

The Tangle app is based on the Pipeline Editor app created by Alexey Volkov as part of the Cloud Pipelines project.

This site is open source. Improve this page.