{openAudit}, le data lineage et les usages de l'information pour transformer les SI

Exit Oracle Data Integrator (or other ELT),   Migrate and permanently break down the complexity of flows.    ODI (Oracle Data Integrator), and other legacy ELT solutions, automatically generate SQL queries that execute directly in the database. We're not telling you anything new 😉. The ELT engine generates new nested subqueries and joins as the system evolves. These transformations eventually become buried within massive SQL blocks, leaving teams with little understanding of them.   Furthermore, traditional ELTs are facing significant challenges from IT modernization projects, the cornerstone of which is often a "move to the cloud." Cloud-native ELTs, which use the same logic as their predecessors, are rapidly expanding: Matillion, DBT, Dataflow (Google), and Glue (Amazon) are just a few examples. They are coupled with powerful cloud databases such as Redshift, BigQuery, and Snowflake. The combination is impressively efficient!    In a migration context, t...

Talend-dbt migration: a passport to modernization its data Talend ETL is very well known for its OS version, "OS" for Open Studio 😊.  Talend, the publisher of the eponymous ETL, was acquired by Qlik in May 2023. The free version of Talend ETL (“TOS”) has not been distributed since early 2024. This means that “TOS” is no longer maintained or updated. Talend Data Fabric, the paid version of "TOS", takes over, with better support, new features, etc. Many companies that had opted for "TOS" are considering leaving the platform to escape the paid model, among other reasons.  Furthermore, a tool called "dbt" (Data Build Tool) is experiencing explosive growth. In this article, we explain how to approach a transition between TOS and dbt.    ETLs  ​ Talend, among others, are generally less popular.  The end of ETL?    ETLs, which allow the data transformation process to be "outsourced" to third-party machines, and thus to "relieve" the...