Real-World Performance Videos on YouTube – Data Warehousing
Here are some videos of a data warehouse demo that the Real-World Performance Group has been running for a while now and we thought it was time to put them on YouTube. Hope you find them informative.
Migrate a 1TB Data warehouse in 20 Minutes (Part 1)
Migrate a 1TB Data warehouse in 20 Minutes (Part 2)
Migrate a 1TB Data warehouse in 20 Minutes (Part 3)
Migrate a 1TB Data warehouse in 20 Minutes (Part 4)
Thanks a lot, very interesting stuff. I Hope there’s more coming :)
[...] http://structureddata.org/2011/06/15/real-world-performance-videos-on-youtube-data-warehousing/ [...]
Is the load using external tables? Is the parallel on the same table? Or are there multiple processes loading different tables in parallel?
Thanks.
The data is loaded with parallel direct path loads (APPEND + PDML) from external tables using the preprocessor as the source flat files are compressed.
Keep the great presentations coming. Everything was worth watching but my top 3 take away are:
1) Doing Set based validation
2) Incremental stats
3) Using query queuing to improve performance which initially seemed counter intuitive.
A quick question:
Does schedule manage queuing by itself or we have to prime it with information about what to queue and how much to queue based on actual queries that will be run (probably not as what do we do than with adhoc queries)?
The queuing used in the videos is Parallel Statement Queuing and there is no priming it.
[...] DWH video [...]