"Paddy: thank you so much for your comment. I totally agree with you - knowing your data is the precursor to come up with the right design and optimization strategy. I have that as an assumption in the article, but should have called it…"
Gifts Received
Stephanie Shen has not received any gifts yet
Stephanie Shen's Page
Latest Activity
Paddy McCarthy commented on Stephanie Shen's blog post Design Principles for Big Data Performance"Also know your data. We run large regressions on an incrementally evolving system. By taking note of past test runtime, we can order the running of tests in the future, to decrease overall runtime.
In other projects, tests are deliberately run in…"
Design Principles for Big Data Performance
The evolution of the technologies in Big Data in the last 20 years has presented a history of battles with growing data volume. The challenge of big data has not been solved yet, and the effort will certainly continue, with the data volume continuing to grow in the coming years. The original relational database system (RDBMS) and the associated OLTP (Online Transaction Processing) make it so easy to work with data using SQL in all aspects, as long as the data size is small enough to manage.…See More
7 Steps to Ensure and Sustain Data Quality
Several years ago, I met a senior director from a large company. He mentioned the company he worked for was facing data quality issues that eroded customer satisfaction, and he had spent months investigating the potential causes and how to fix them. “What have you found?” I asked eagerly. “It is a tough issue. I did not find a single cause, on the contrary, many things went wrong,” he replied. He then started citing a long list of what contributed to the data quality issues - almost every…See More
7 Steps to Ensure and Sustain Data Quality
Several years ago, I met a senior director from a large company. He mentioned the company he worked for was facing data quality issues that eroded customer satisfaction, and he had spent months investigating the potential causes and how to fix them. “What have you found?” I asked eagerly. “It is a tough issue. I did not find a single cause, on the contrary, many things went wrong,” he replied. He then started citing a long list of what contributed to the data quality issues - almost every…See More
Big Data Architecture in Data Processing and Data Access
I started my career as an Oracle database developer and administrator back in 1998. Over the past 20+ years, it has been amazing to see how IT has been evolving to handle the ever growing amount of data, via technologies including relational OLTP (Online Transactional Processing) database, data warehouse, ETL (Extraction, Transformation and Loading) and OLAP (Online Analytical Processing) reporting, big data and now AI, Cloud and IoT. All these technologies were enabled by the rapid growth in…See More
Big Data Architecture in Data Processing and Data Access
I started my career as an Oracle database developer and administrator back in 1998. Over the past 20+ years, it has been amazing to see how IT has been evolving to handle the ever growing amount of data, via technologies including relational OLTP (Online Transactional Processing) database, data warehouse, ETL (Extraction, Transformation and Loading) and OLAP (Online Analytical Processing) reporting, big data and now AI, Cloud and IoT. All these technologies were enabled by the rapid growth in…See More
"Great article - Very insightful!"
Master Data Management (MDM): an Essential Part of Data Strategy
First of all, what is Master Data Management (MDM)? Master data refers to the critical data that are essential to an enterprise’s business and often used in multiple disciplines and departments. MDM is the establishment and maintenance of an enterprise level data service that provides accurate, consistent and complete master data across the enterprise and to all business partners.The concept of Master Data Management originated around 2008 when data warehousing and ERP applications became…See More
Master Data Management (MDM): an Essential Part of Data Strategy
First of all, what is Master Data Management (MDM)? Master data refers to the critical data that are essential to an enterprise’s business and often used in multiple disciplines and departments. MDM is the establishment and maintenance of an enterprise level data service that provides accurate, consistent and complete master data across the enterprise and to all business partners.The concept of Master Data Management originated around 2008 when data warehousing and ERP applications became…See More
Profile Information
- Short Bio
- Executive of over 20 years of experience in big data processing, data management and data strategy, with turn-around executions and strong team building expertise.
- My Web Site Or LinkedIn Profile
- http://https://www.linkedin.com/in/stephanie-shen-1465601/
- Field of Expertise
- Data Science, Machine Learning, Business Analytics, Deep Learning, BI, IoT
- Professional Status
- VP
- Years of Experience:
- 20
- Your Company:
- The NPD Group Inc.
- Industry:
- Market Research
- Your Job Title:
- Senior Vice President, Data & System Integration
- How did you find out about DataScienceCentral?
- News letter
- Interests:
- Contributing, Networking, Finding a new position, New venture
Stephanie Shen's Blog
Design Principles for Big Data Performance
Posted on September 29, 2019 at 4:00pm 1 Comment 1 Like
The evolution of the technologies in Big Data in the last 20 years has presented a history of battles with growing data volume. The challenge of big data has not been solved yet, and the effort will certainly continue, with the data volume continuing to grow in the coming years. The original relational database system (RDBMS) and the associated OLTP (Online Transaction Processing) make it so easy to work with data using SQL in all aspects, as long as the data size is small enough to…
Continue 7 Steps to Ensure and Sustain Data Quality
Posted on July 28, 2019 at 3:30pm 0 Comments 1 Like
Several years ago, I met a senior director from a large company. He mentioned the company he worked for was facing data quality issues that eroded customer satisfaction, and he had spent months investigating the potential causes and how to fix them. “What have you found?” I asked eagerly. “It is a tough issue. I did not find a single cause, on the contrary, many things went wrong,” he replied. He then started citing a long list of what contributed to the data quality issues - almost…
Continue Big Data Architecture in Data Processing and Data Access
Posted on June 23, 2019 at 7:30am 0 Comments 0 Likes
I started my career as an Oracle database developer and administrator back in 1998. Over the past 20+ years, it has been amazing to see how IT has been evolving to handle the ever growing amount of data, via technologies including relational OLTP (Online Transactional Processing) database, data warehouse, ETL (Extraction, Transformation and Loading) and OLAP (Online Analytical Processing) reporting, big data and now AI, Cloud and IoT. All these technologies were enabled by the rapid…
Master Data Management (MDM): an Essential Part of Data Strategy
Posted on May 5, 2019 at 8:35am 0 Comments 0 Likes
First of all, what is Master Data Management (MDM)? Master data refers to the critical data that are essential to an enterprise’s business and often used in multiple disciplines and departments. MDM is the establishment and maintenance of an enterprise level data service that provides accurate, consistent and complete master data across the enterprise and to all business partners.The concept of Master Data Management originated around 2008 when data warehousing and ERP…
Continue Comment Wall
- No comments yet!
Resources
Videos
© 2019 Data Science Central ®
Powered by
Badges | Report an Issue | Privacy Policy | Terms of Service
