Subscribe to DSC Newsletter
Deborah Hurley
  • Female
  • Upton, MA
  • United States
Share on Facebook
Share

Deborah Hurley's Discussions

Use of Data Profiling Tools to Increase Accuracy of Training Data

Started this discussion. Last reply by Deborah Hurley Jan 8. 6 Replies

I am not a Data Scientist, although I do have an intermediate-level understanding of AI / ML.  I am curious as to whether commercial or open source data profiling tools might be used to discover…Continue

Gifts Received

Gift

Deborah Hurley has not received any gifts yet

Give a Gift

 

Deborah Hurley's Page

Latest Activity

Deborah Hurley replied to Deborah Hurley's discussion Use of Data Profiling Tools to Increase Accuracy of Training Data
"Thank you - this is the information I was looking for. Were you able to automate the process so that after establishing basic rules for quality, there was minimal human intervention prior to delivery of data to data science tool?"
Jan 8
Richard Boire replied to Deborah Hurley's discussion Use of Data Profiling Tools to Increase Accuracy of Training Data
"There are a number of tools out there, Alteryx being one. My previous company built our own customized tool which delivers the results that you are looking for. We created an automated tool that delivered three outputs on a given file: a)random…"
Jan 4
Tim Matteson liked Deborah Hurley's discussion Use of Data Profiling Tools to Increase Accuracy of Training Data
Jan 2
Deborah Hurley replied to Deborah Hurley's discussion Use of Data Profiling Tools to Increase Accuracy of Training Data
"I believe that your synopsis is correct.  The only difference here is that I would suggest doing the profiling prior to any iterations.  I had recently worked with a very large data set to determine the data quality before releasing the…"
Dec 29, 2018
Raymond K Roberts replied to Deborah Hurley's discussion Use of Data Profiling Tools to Increase Accuracy of Training Data
"Well take for instance in R, the package set 'Tidyverse', where it has an option to read in a file, where you can then exercise an option called 'problems', and it gives you summary information and also some initial pertinent…"
Dec 25, 2018
Deborah Hurley replied to Deborah Hurley's discussion Use of Data Profiling Tools to Increase Accuracy of Training Data
"Yes, but may also cut down on the time taken in training iterations to 'clean' the data or determine the relative quality of the data.   There have been a couple of blog entries and articles recently stating that Data Scientists are…"
Dec 22, 2018
Raymond K Roberts replied to Deborah Hurley's discussion Use of Data Profiling Tools to Increase Accuracy of Training Data
"If I am understanding, I think you are asking is there some set of 'exploratory' actions that are taken a larger portion of the time when a dataset is first presented, that, given what is learned, allows a determined direction to proceed ?"
Dec 22, 2018
Deborah Hurley updated their profile
Dec 11, 2018
Deborah Hurley posted a discussion

Use of Data Profiling Tools to Increase Accuracy of Training Data

I am not a Data Scientist, although I do have an intermediate-level understanding of AI / ML.  I am curious as to whether commercial or open source data profiling tools might be used to discover patterns in a dataset prior to using the dataset as training data.Big data has posed a volume challenge to some of the profiling tools (IBM, Informatica, Oracle, etc.),  but most vendors have addressed or are continuing to address this issue and will connect to the big data platform directly (as opposed…See More
Dec 5, 2018

Profile Information

My Web Site Or LinkedIn Profile
http://www.linkedin.com/in/dahdata
Field of Expertise
Business Analytics, BI, Other
Professional Status
Technical
Years of Experience:
20+
Your Company:
Dragon Data Consulting, LLC
Industry:
IT
Your Job Title:
Owner/Consultant
How did you find out about DataScienceCentral?
LinkedIn
Interests:
Networking, Other

Comment Wall

You need to be a member of Data Science Central to add comments!

Join Data Science Central

  • No comments yet!
 
 
 

Videos

  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service