Lars Fiedler's Blog (2)

Composable Dataflows vs Python Scripts

I started to think more about the data prep and cleansing use cases, and why someone would choose to develop those as Composable Dataflows versus using something like Python scripts.  Yes, either one will get the job done, but there are factors like development time, debug-ability, execution speed, and re-usability which can be deciding factors.  By buying into the dataflow methodology, there are some big value…


Added by Lars Fiedler on September 16, 2016 at 6:30am — No Comments

Hadoop is Dead. DataFlow is Alive!

We've given Hadoop almost 10 years to mature, invested billions, and very few companies are  seeing the return on investment.  Several companies have tried to make Hadoop a real-time analytical platform, incorporating SQL-like facades on top, but the latency is still not where it needs to be for interactive applications.  Even Google, a true big data user, has moved on and is using more dataflow / flow-based programming approaches.    Why?  It just makes sense...

  • Why should I…

Added by Lars Fiedler on September 27, 2014 at 7:30am — No Comments

© 2021   TechTarget, Inc.   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service