Subscribe to DSC Newsletter
Abe Gong
  • Male
  • United States
Share on Facebook
Share

Gifts Received

Gift

Abe Gong has not received any gifts yet

Give a Gift

 

Abe Gong's Page

Latest Activity

christopher calvin commented on Abe Gong's blog post Rapid hadoop development with progressive testing
"Reminds me of the mainframe days when cards were used and turn-around was overnight."
Jul 12, 2013
Abe Gong posted a blog post

Rapid hadoop development with progressive testing

Debugging Hadoop jobs can be a huge pain.  The cycle time is slow, and error messages are often uninformative --- especially if you're using Hadoop streaming, or working on EMR. I once found myself trying to debug a job that took a full six hours to fail.  It took more than a week -- a whole week! -- to find and fix the problem.  Of course, I was doing other things at the same time, but the need to constantly check up on the status of the job was a huge drain on my energy and productivity.  It…See More
Jul 10, 2013
Abe Gong is now a member of Data Science Central
May 10, 2013

Profile Information

Short Bio
Lead data scientist at Jawbone.
My Web Site Or LinkedIn Profile
http://abegong.com
Professional Status
Technical
Years of Experience:
10?
Your Company:
Jawbone
Interests:
Networking

Abe Gong's Blog

Rapid hadoop development with progressive testing

Posted on July 10, 2013 at 10:47am 1 Comment

Debugging Hadoop jobs can be a huge pain.  The cycle time is slow, and error messages are often uninformative --- especially if you're using Hadoop streaming, or working on EMR.



I once found myself trying to debug a job that took a full six hours to fail.  It took more than a week -- a whole week! -- to find and fix the problem.  Of course, I was doing other things at the same time, but the need to constantly check up on the status of the job was a huge drain on my energy and…

Continue

Comment Wall

You need to be a member of Data Science Central to add comments!

Join Data Science Central

  • No comments yet!
 
 
 

Videos

  • Add Videos
  • View All

© 2019   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service