Subscribe to DSC Newsletter
Toby Coleman
  • United Kingdom
Share on Facebook
Share

Toby Coleman's Discussions

Integrating with data sources

Started this discussion. Last reply by Purva Shah Apr 15. 3 Replies

What kind of tools do data scientists and engineers use for integrating with external data sources?Taking a typical problem where:External data exists on an API;Data scientist/engineer wants to poll…Continue

Gifts Received

Gift

Toby Coleman has not received any gifts yet

Give a Gift

 

Toby Coleman's Page

Latest Activity

Purva Shah replied to Toby Coleman's discussion Integrating with data sources
"There are no standards associated to this, but this may help in solving the problem. Scripts/programs written using programming languages (like python, java,etc.) can get the data by hitting the api-endpoints and dumping it into relational…"
Apr 15
Darren Wagner replied to Toby Coleman's discussion Integrating with data sources
"I'd say we tend to see a few different trends. Early on (junior level, small company, simple tasks, etc) we see a lot of locally maintained scripts. Python running with Jupyter for example is an especially common one. Scripts on a server…"
Aug 23, 2019
Toby Coleman's discussion was featured

Integrating with data sources

What kind of tools do data scientists and engineers use for integrating with external data sources?Taking a typical problem where:External data exists on an API;Data scientist/engineer wants to poll this periodically and add the data to their own database/data warehouse.What kind of tools are people using for this task (Airflow, bespoke scripts)?See More
Aug 22, 2019
Toby Coleman posted a discussion

Integrating with data sources

What kind of tools do data scientists and engineers use for integrating with external data sources?Taking a typical problem where:External data exists on an API;Data scientist/engineer wants to poll this periodically and add the data to their own database/data warehouse.What kind of tools are people using for this task (Airflow, bespoke scripts)?See More
Aug 22, 2019

Profile Information

Job Title:
Data Scientist
Job Function:
Data Science, Machine Learning, AI, IoT
Interests:
Contributing, Networking

Comment Wall

You need to be a member of Data Science Central to add comments!

Join Data Science Central

  • No comments yet!
 
 
 

Videos

  • Add Videos
  • View All

© 2020   Data Science Central ®   Powered by

Badges  |  Report an Issue  |  Privacy Policy  |  Terms of Service