Subscribe to DSC Newsletter

Database Revolution - The Future of Information Publishing

Here’s a brilliant presentation from Mike Bowers, Principal Engineer at the Church of Jesus Christ of Latter Day Saints.  It accomplishes two major objectives; Mike reviews the strengths and weaknesses of the five major classes of databases today (relational, dimensional, object, graph and document).  He then dissects the major NoSQL databases on the market including MarkLogic, Mongo, Riak, Cloudant/Couch DB and Cassandra.  How do they stack up? Are they enterprise ready?  If developer productivity, application performance and enterprise readiness are concerns that your company has, this video is a “must see”.  You can watch the video here:

http://www.scoop.it/t/big-data-technology-applications-and-analytics

Here's a short summary for Data Science Central

With over 80 % of the data being created today is unstructured (probably better termed poly-structured), organizations need to store, search and analyze hundreds of different data formats at light speed.   The ability to handle data variability, data variety and data relevance has jumped to the top of the agenda for both business and IT. But how can organizations discern meaning from this data?   How do they create context around unstructured data that exists in so many forms while also making it discoverable?  

Relational Models are not well suited to handle the problem since they were designed to organize your data in rows, columns and tables.  The variety and complexity of unstructured data coupled with the overriding need to scale out on commodity hardware prevent them from leveraging over 80% of the data today.  And there’s no end in sight. 

Mike shows a great example of how the document database (NoSQL database) takes unstructured data in the form of a story, identifies the data elements in the story (topic, location, author), semantically links these elements to show relationships between the elements and then identifies the hierarchy within the story (title, subtitle, body, etc…).   Armed with all of this, the unstructured data lives with context.  The original document persists but now all of the elements are discoverable in a variety of ways.  

Given the reality that unstructured data is growing so rapidly and needs to be integrated and analyzed alongside structured data to complete the picture, what does an application need from a NoSQL database?  Basically what every database needs - five core capabilities.  The basic requirements are 1) inserts, updates and deletes 2) the ability to query the data 3) the ability to search the data 4) the ability to bulk process the data and 5) the ability to do all of this consistently.  With extraordinary data volumes, this has to be done at scale in an affordable way.  

Mike evaluates search relevance, advanced search using facets, geo-spatial search, entity enrichment, data consistency, developer productivity using JAVA, the ability to retrieve multiple documents, integration with the BI stack using SQL, real time data ingestion, indexing and much more.   Imagine if you had to ask your programmers to develop an application to handle data locks, threading bugs, serialization, dead locks and rare conditions?     Imagine if you had to write the code to ensure all parts of your data transactions succeeded?  How would you ensure all of the data has been committed consistently? Do the commits meet all of your data rules?    How do you ensure your data survives system failures and can be recovered after an inadvertent deletion?   

Mike answers these questions and much more.  

Learn more at www.marklogic.com

Views: 330

Tags: analytics, big, bowers, data, database, databases, dimension, graph, marklogic, mike, More…noql, object, relational

Comment

You need to be a member of Data Science Central to add comments!

Join Data Science Central

Videos

  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service