We use open source tooling as much as reasonably possible. For when the exisitng tech falls short, we create our own solutions.
Robotron
One such solutions is Robotron, a work in progress that automates data engineering.
Robotron was born from always wanting to improve and automate as much as we can, so we create the relevant generalisations for our trade that allow us to manage data deployments gracefully.
Robotron automates the usage of common data tools to seamlessly integrate them with good development practices (code reuse, testing etc)
If data analysts manually munge data, data engineers build pipes to make the data flow, then Robotron is a pipe building and laying machine 🙂