This is it, Pipestack's initial release 🎉! Don't let that fool you though, here's what I shipped.
Platform
- Defined the YAML config schema
- Configured CI / CD
- Set up a project on Railway
- Developed an
infra_manager to, you guessed it, manage infrastructure for individual workspaces created in Pipestack - Developed a
pipeline_manager used by the web app, future CLI, and a public API to manage pipelines - Deployed and configured wasmCloud, NATS, and OpenTelemetry (Prometheus, Tempo, Loki, Grafana)
CLI
- Not started yet. I'm torn between my CLI template and a more forward-looking approach where each CLI command is a Wasm Component. Anyone could extend the CLI with their own commands, written in a programming language they're familiar with
Web
- Started a new Remult project with SvelteKit, shadcn-svelte, and Svelte Flow
- Created the marketing landing page based on a $30 template
- Put in place a newsletter infrastructure
- Developed the drag & drop interface used for the pipeline builder and observability
- Added a real-time log viewer for each node within a pipeline
Sources
- NEW Webhook
- You can send a
GET or more likely POST request to kick off a pipeline
Processors
- NEW Wasm Component
- Upload your own Wasm Component
Sinks
- NEW Webhook
- Take the output of a pipeline and send it to your API endpoint(s)
Miscellaneous