Virtualize first, instantiate where needed…
One of the ongoing complaints about many data warehouse projects is that they take too long to delivery. This is one of the main reasons that many of us have tried to adopt methods and techniques (like SCRUM) from the agile software world to improve our ability to deliver data warehouse components more quickly.
So, what activity takes the bulk of development time in a data warehouse project?
Writing (and testing) the ETL code to move and transform the data can take up to 80% of the project resources and time.
So if we can eliminate, or at least curtail, some of the ETL work, we can deliver useful data to the end user faster.
One way to do that would be to virtualize the data marts.
For several years Dan Linstedt and I have discussed the idea of building virtual data marts on top of a Data Vault modeled…
View original post 593 more words