Modern Data Stack : Centralize intelligence, not data...

 

Modern Data Stack :

Centralize intelligence, not data...

Each BI tool vendor has invented its own "language," its own grammar, its own internal logic.
Examples include DAX, MDX, LookML, Semantic Models, etc.


And each tool adds its own internal mechanisms, which change completely from one tool to another.

Next, users create specific business rules, which are not always the same from one dashboard to another, from one technology to another, sometimes replicated, sometimes adapted… with subtle variations that create uncertainty.

 

So we "patch", we "tinker", and we end up consolidating a business logic specific to each tool... which amounts, slowly but surely, to creating a... fatal dependency.

 

There are several options to change this situation.

 

Centralizing data preparation in modern and scalable databases has real advantages :

  • We "empty" the BI layer of its complexity, we create transparency.

  • We centralize business logic in a single location. This effectively creates interoperability on the BI side.

 

But in practice, centralizing all the preparation quickly becomes very cumbersome.  Three concrete examples:

  • Every business change requires IT intervention.
  • Pipelines need to be completely replayed to update a simple dashboard, with cloud costs skyrocketing.
  • And above all, a BI platform is (almost) always multi-source, and switching everything back to a single data source represents a huge migration effort. This leaves complex, difficult-to-maintain dependencies.

 

In short, in this scenario, we largely lose the flexibility and responsiveness favored by the business (self-BI).

 
 

See also: 

Commentaires

Posts les plus consultés de ce blog

E-book / Maîtriser & Simplifier une plateforme SAP BO avec {openAudit}

La 1ère action de modernisation d’un Système d'Information : Ecarter les pipelines inutiles ?

Migration Talend-dbt : un passeport pour moderniser ses données