Coming from…
Coming from Dataiku
If you build flows in Dataiku, Daedalus will feel close to home. You still draw a flow of
steps from data to results. The difference is where it runs: on your own computer, with no
server to set up, and your data stays there.
What feels familiar
- The Flow is the canvas. You connect steps left to right, and you can see the whole workflow at a glance.
- A recipe is a node. Group, Join, Stack, Pivot, Sort and Split each have a node of their own.
- A dataset is a node's output. Select any node and its rows appear under the canvas, in the Data tab. Column types are in the Metadata tab.
- Code recipes still exist. Write SQL in a DuckDB Query node. For Python, describe the step in words to a Code Gen node, or open any node's code with the pencil and edit it by hand.
- Scenarios become scheduled runs. Deploy & schedule to cloud runs the workflow on a timetable and keeps a history of each run.
- Dashboards become reports. The Reporting panel on the right holds your report layout, and a Write Report node turns it into a PDF, an HTML page or a PowerPoint deck.
What's different
- A Prepare recipe is a chain of nodes. Each processor is its own node, so you can look at the data after every step.
- No "build" step. Press Run and Daedalus recomputes the nodes that are out of date. Nodes you haven't changed keep their last result.
- No machine-learning lab. There is Linear Regression and a Forecast node for time series, but no model training, scoring or evaluation screens.
- A different set of connectors. Files, PostgreSQL, MySQL, SQLite, S3, Snowflake, Salesforce and web APIs are built in. Some databases Dataiku connects to are not, yet. See the list below.
No equivalent yet
Some Dataiku tools have no Daedalus node yet. Searching for them shows a hint instead of
an empty list. These are the ones you are most likely to miss:
| Dataiku name | What to do instead |
| Train | No general model training yet; Linear Regression fits OLS and Forecast fits time series |
| Score | No model scoring; apply coefficients with Add Column |
| Evaluate | No model evaluation; compare with Add Column metrics |
| Cluster | No clustering yet; describe it to a Code Gen node |
| Principal Component Analysis | No PCA node yet; describe it to a Code Gen node |
| Text Embedding | No embeddings yet; describe it to a Code Gen node |
| Statistical tests | No test nodes yet; describe the test to a Code Gen node |
| Upsert | No upsert/merge write; Union + Distinct (keep last), then write |
| Excel Templater | No template filling; Write Excel writes plain named sheets |
| Shell | No shell steps; do the work in a Code Gen (Python) node |
| SparkR | No R support; rewrite the logic in a Code Gen (Python) node |
| Managed folders | Point readers at a project folder path instead |
| Google BigQuery | Not supported yet; export it to Parquet/CSV and read that file |
| Microsoft SQL Server | Not supported yet; export it to Parquet/CSV and read that file |
| Oracle | Not supported yet; export it to Parquet/CSV and read that file |
| Databricks | Not supported yet; export it to Parquet/CSV and read that file |
| Delta Lake | Not supported yet; export it to Parquet/CSV and read that file |
| SCP / SFTP | Not supported yet; download the file first, then read it |
| Flag holidays | No holiday calendar; Lookup a holiday table on the date |
Tips
- Search with the names you know. Typing Group, Stack or Fold multiple columns finds Aggregate, Union and Unpivot.
- Rebuild a Prepare recipe one step at a time. Add a node per processor and check the Data tab after each one. A wrong step is easy to spot because every step has its own output.
- Turn checks into a gate. Assert stops the run when the data breaks a rule. Expectations scores the data against the same kind of rules but never stops the run.
- Before you schedule, check your sources. A cloud run has to reach every source. A database on your own network needs its drone made available to cloud runs first; the deploy dialog tells you which sources are ready.
- Ask the Assistant. Describe the recipe in words, for example "group sales by region and keep the top 5", and it can build the nodes for you. You see each change it makes and can undo it.