Subscribe to DSC Newsletter
Nathan Lee
  • Male
  • Gillingham
  • United Kingdom
Share on Facebook
Share

Nathan Lee's Discussions

Automated data quality checks

Started this discussion. Last reply by Samuel Situmeang Jul 23. 1 Reply

Does anyone have any advice for good data quality audit processes/ checks?I have a live data set and I have a number of criteria which each record must have. Some sensical and logical checks. Such as…Continue

Tags: wrangling, audit, quality, data

Gifts Received

Gift

Nathan Lee has not received any gifts yet

Give a Gift

 

Nathan Lee's Page

Latest Activity

Samuel Situmeang replied to Nathan Lee's discussion Automated data quality checks
"Here is a good start to do that: https://github.com/SauceCat/pydqc. Good luck!"
Jul 23
Nathan Lee posted a discussion

Automated data quality checks

Does anyone have any advice for good data quality audit processes/ checks?I have a live data set and I have a number of criteria which each record must have. Some sensical and logical checks. Such as missing fields, if this field is x then this field must have a date and anomaly detection.Has anyone got any suggestions- currently the process I run is very manual filtering the data to check. I wonder if there is a better way.I am thinking a algorithm which I can press run and it will run these…See More
Jul 3

Profile Information

Field of Expertise
Data Science, Business Analytics
Professional Status
Technical
Years of Experience:
2
Your Job Title:
Sales Analyst
Interests:
Contributing, Networking, Finding a new position, New venture

Comment Wall

You need to be a member of Data Science Central to add comments!

Join Data Science Central

  • No comments yet!
 
 
 

Videos

  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service