Subscribe to DSC Newsletter
Abe Gong
  • Male
  • United States
Share on Facebook

Gifts Received


Abe Gong has not received any gifts yet

Give a Gift


Abe Gong's Page

Profile Information

Short Bio
Lead data scientist at Jawbone.
My Web Site Or LinkedIn Profile
Professional Status
Years of Experience:
Your Company:

Abe Gong's Blog

Rapid hadoop development with progressive testing

Posted on July 10, 2013 at 10:47am 1 Comment

Debugging Hadoop jobs can be a huge pain.  The cycle time is slow, and error messages are often uninformative --- especially if you're using Hadoop streaming, or working on EMR.

I once found myself trying to debug a job that took a full six hours to fail.  It took more than a week -- a whole week! -- to find and fix the problem.  Of course, I was doing other things at the same time, but the need to constantly check up on the status of the job was a huge drain on my energy and…


Comment Wall

You need to be a member of Data Science Central to add comments!

Join Data Science Central

  • No comments yet!


  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service