Subscribe to DSC Newsletter

 

See: http://bit.ly/RWBoCk

 

Views: 20802

Comment

You need to be a member of Data Science Central to add comments!

Join Data Science Central

Comment by Brad Sheridan on July 29, 2013 at 9:23am

I echo Andrew's question about whether or not to expect more from built from scratch columnar databases.  Anyone have insight?  We are using Tableau against Oracle and the performance isn't great when hitting a billion row table.

Comment by Dr. Vijay Srinivas Agneeswaran on October 28, 2012 at 10:07pm

Just a suggestion. It might be more appropriate to bracket Amazon Dynamo as the key-value pair NoSQL DB, rather than Amazon S3. S3 use cases are different - possibly for content delivery, analysis, archival, disaster recovery etc.

Vijay

Comment by Michael Walker on October 26, 2012 at 2:04pm

Microsoft claims:

"SQL Server is a general-purpose database system that traditionally stores data in row format. To improve

performance on data warehousing queries, SQL Server 2012 adds columnar storage and efficient batch-at-atime processing to the system. Columnar storage is exposed as a new index type: a column store index. In other
words, in SQL Server 2012 an index can be stored either row-wise in a B-tree or column-wise in a column store
index. SQL Server column store indexes are “pure” column stores, not a hybrid, because different columns are
stored on entirely separate pages. This improves I/O performance and makes more efficient use of memory."

See: http://sites.computer.org/debull/A12mar/apollo.pdf

Comment by Andrew Gibson on October 26, 2012 at 7:19am

Nice summary - thanks for posting!  I wonder if you can provide any commentary on the new ColumnStore Indexes in SQL Server 2012.  Is this providing true columnar storage?  My own testing suggests approximately 10x speed increases summarizing the same 50 million record fact table with the same SQL query.  That's a fantastic improvement to have but should I be looking for more from a database designed to handle columnar storage from scratch?

© 2018   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service