Comments on: Facebook: Hive – A Petabyte Scale Data Warehouse Using Hadoop http://structureddata.org/2009/06/10/facebook-hive-a-petabyte-scale-data-warehouse-using-hadoop/?utm_source=rss&utm_medium=rss&utm_campaign=facebook-hive-a-petabyte-scale-data-warehouse-using-hadoop Oracle Database Performance and Scalability Blog Tue, 07 Sep 2010 20:58:50 +0000 hourly 1 http://wordpress.org/?v=3.0.1 By: savara » Blog Archive » Software za Facebookemhttp://structureddata.org/2009/06/10/facebook-hive-a-petabyte-scale-data-warehouse-using-hadoop/comment-page-1/#comment-11701 savara » Blog Archive » Software za Facebookem Mon, 12 Jul 2010 18:13:25 +0000 http://structureddata.org/?p=584#comment-11701 [...] aplikace – Hive – pochází přímo z jádra Facebooku a umožňuje zasílat SQL dotazy na Hadoop; celý systém [...] [...] aplikace – Hive – pochází přímo z jádra Facebooku a umožňuje zasílat SQL dotazy na Hadoop; celý systém [...]

]]> By: Anjohttp://structureddata.org/2009/06/10/facebook-hive-a-petabyte-scale-data-warehouse-using-hadoop/comment-page-1/#comment-551 Anjo Wed, 22 Jul 2009 14:43:11 +0000 http://structureddata.org/?p=584#comment-551 There is a new kid on the block, it is called HadoopDB, I think it can combine the strong points of Hadoop and a RDBMS. See http://dbmsmusings.blogspot.com/2009/07/announcing-release-of-hadoopdb-longer.htmlMaybe you can use Oracle instead msql or progresql? There is a new kid on the block, it is called HadoopDB, I think it can combine the strong points of Hadoop and a RDBMS. See http://dbmsmusings.blogspot.com/2009/07/announcing-release-of-hadoopdb-longer.html

Maybe you can use Oracle instead msql or progresql?

]]> By: Chris Adkinhttp://structureddata.org/2009/06/10/facebook-hive-a-petabyte-scale-data-warehouse-using-hadoop/comment-page-1/#comment-552 Chris Adkin Wed, 17 Jun 2009 21:38:40 +0000 http://structureddata.org/?p=584#comment-552 I've been working with Oracle for over eleven years and I would not want to give the impression that I'm a RDBMS or Oracle zealot. However, as much as I appreciate one size does not always fit all, I would dispute the claim that what the Facebook have got is a data warehouse in the context of something that can be mined or allow value to be extracted from using BI tools. I would assume that what they have both lacks the tooling and constructs (things like mviews, bit mapping indexes etc . . ) to allow this be performed on such a large amount of data. However, if this does what want, is scalable and runs off cheap commodity hardware, you can't knock it too much. What would be really interesting would be something that allows Petabyte scalability of web content and BI + data mining. It will be interesting to see what comes along with 11gR2. Within the constraints of not breaching any NDAs, people have told me that there is some interesting stuff coming along. Could this be the sort of stuff that will take Oracle more in the direction of what Facebook have done with hadoop . . . I guess we shall find out at Open World 2009. I’ve been working with Oracle for over eleven years and I would not want to give the impression that I’m a RDBMS or Oracle zealot. However, as much as I appreciate one size does not always fit all, I would dispute the claim that what the Facebook have got is a data warehouse in the context of something that can be mined or allow value to be extracted from using BI tools. I would assume that what they have both lacks the tooling and constructs (things like mviews, bit mapping indexes etc . . ) to allow this be performed on such a large amount of data. However, if this does what want, is scalable and runs off cheap commodity hardware, you can’t knock it too much. What would be really interesting would be something that allows Petabyte scalability of web content and BI + data mining. It will be interesting to see what comes along with 11gR2. Within the constraints of not breaching any NDAs, people have told me that there is some interesting stuff coming along. Could this be the sort of stuff that will take Oracle more in the direction of what Facebook have done with hadoop . . . I guess we shall find out at Open World 2009.

]]> By: Noonshttp://structureddata.org/2009/06/10/facebook-hive-a-petabyte-scale-data-warehouse-using-hadoop/comment-page-1/#comment-550 Noons Thu, 11 Jun 2009 00:33:38 +0000 http://structureddata.org/?p=584#comment-550 Heck, we pump 0.3TB/day into our DW with a commercial db and 1/10000 of the budget of Facebook. I defy anyone to prove in simple terms, not market-speak, what value can be extracted and in what terms/what purpose from a 15TB/day DW! But I have no doubts it can be demonstrated: Stonebraker has been at the forefront of impossible projects for so long nothing surprises me anymore on that front... Heck, we pump 0.3TB/day into our DW with a commercial db and 1/10000 of the budget of Facebook.
I defy anyone to prove in simple terms, not market-speak, what value can be extracted and in what terms/what purpose from a 15TB/day DW!
But I have no doubts it can be demonstrated: Stonebraker has been at the forefront of impossible projects for so long nothing surprises me anymore on that front…

]]>