Subscribe to DSC Newsletter
Abe Gong
  • Male
  • United States
Share on Facebook
Share

Gifts Received

Gift

Abe Gong has not received any gifts yet

Give a Gift

 

Abe Gong's Page

Profile Information

Short Bio
Lead data scientist at Jawbone.
My Web Site Or LinkedIn Profile
http://abegong.com
Professional Status
Technical
Years of Experience:
10?
Your Company:
Jawbone
Interests:
Networking

Abe Gong's Blog

Rapid hadoop development with progressive testing

Posted on July 10, 2013 at 10:47am 1 Comment

Debugging Hadoop jobs can be a huge pain.  The cycle time is slow, and error messages are often uninformative --- especially if you're using Hadoop streaming, or working on EMR.



I once found myself trying to debug a job that took a full six hours to fail.  It took more than a week -- a whole week! -- to find and fix the problem.  Of course, I was doing other things at the same time, but the need to constantly check up on the status of the job was a huge drain on my energy and…

Continue

Comment Wall

You need to be a member of Data Science Central to add comments!

Join Data Science Central

  • No comments yet!
 
 
 

Videos

  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service