Home » Uncategorized

DSC Weekly 6 February 2024

  • Scott Thompson 

Announcements

  • Developing high-quality software can quickly devolve into a chaotic, unproductive mess without the proper processes and frameworks in place. Organizations require not only the right coding tools but also effective testing and deployment solutions to ensure the highest quality software is what hits the market. The proliferation of generative AI, open-source technologies and low-code/no-code tools can streamline and enhance developer tasks but only if they are applied as part of a bigger strategy that empowers developers to innovate more efficiently. Tune into the Software Development Methodologies summit to hear leading experts share the latest development tools and trends to smooth over and enhance what quickly becomes a complicated process.
  • Sustainable IT is the backbone of the green economy. As businesses become increasingly reliant on artificial intelligence and other resource-intensive technologies, actionable measures need to be taken to reduce the environmental and social impact of technological innovation. Tune into the upcoming Achieving IT Sustainability Goals summit to hear leading experts discuss strategies for tracking carbon emissions metrics, enhancing direct current energy efficiency, optimizing data usage, and other methods to help design a sustainable IT strategy that delivers tangible results. 

Top Stories

  • Digital twins, interoperability and FAIR model-driven development
    February 5, 2024
    by Alan Morrison
    In July 2023, Teresa Tung, managing director and cloud-first chief technologist at Accenture, gave a Factory of the Future talk at the Databricks Data + AI Summit on digital twins, knowledge graphs, and generative AI for warehouse automation. Two points she made that resonated with me: 1) Digital twins are for end-to-end automation, and 2) a knowledge graph in the mix can be “a twin of twins” that provides the semantic layer, the meaning and the means of interoperability between all the twins so that the system as a whole can deliver cohesive insight for overall optimization and other decision making.
  • Your AI Journey: Start Small AND Strategic – Part 1
    February 3, 2024
    by Bill Schmarzo
    Avoid the AI siren song. Avoid the advice that leads you to believe an artificial intelligence (AI) project is just like any other IT project and that the approach you used for your ERP / MRP / BFA / CRM implementations will work here.  Be cautious of the “start small” advice.
  • Better LLMs with Shorter Embeddings: Part 3
    January 31, 2024
    by Vincent Granville
    In this article, I discuss some secret sauce to further reduce the size of the token database by several orders of magnitude. This makes scalability a lot easier and much less costly. Finally, a key to success is fast search, for instance ANN vector search. Here, ANN stands for approximate nearest neighbors. I explain how to adapt fast search to my slightly unusual architecture.
Education_DSC_160x600-2

In-Depth

  • How to Enhance Data Quality in Your Data Pipeline
    February 6, 2024
    by Ovais Naseem
    In the data-driven world of modern business, the quality of data flowing through your pipelines is just as critical as the data itself. High-quality data is the lifeblood of insightful analytics and informed decision-making.
  • 5 trends & advances that are set to define cloud security in 2024
    February 5, 2024
    by Rob Turner
    Let’s dive into the cloud, but not just any cloud—the cloud of the future, specifically the realm of cloud security in 2024. We’re not just talking about your everyday, run-of-the-mill updates here. We’re looking at the big players, the game changers, the trends that are going to set the stage for how we protect our digital skies. So, grab your virtual umbrella (or shield, for that matter), and let’s explore these five trends set to redefine cloud security in 2024.
  • Building robust API: step-by-step guide
    February 3, 2024
    by Ovais Naseem
    In the realm of modern software development, Application Programming Interfaces (APIs) stand as the backbone of data engineering, facilitating seamless data exchange and integration. As an expert in data engineering, big data, and file formats, I understand the pivotal role APIs play in today’s technological landscape.
  • What data scientists overlook when it comes to knowledge graphs
    February 1, 2024
    by Alan Morrison
    The good news is that the data science community is taking more of an interest in knowledge graphs lately. But unsurprisingly, some data science folks exploring graphs themselves are barely scratching the surface of knowledge graph potential.
  • Mastering E-commerce data governance: Best practices, challenges, and future trends for quality, compliance, and growth
    January 31, 2024
    by John Lee
    Data governance is more important than ever in e-commerce, where massive amounts of data are generated and processed daily. Big Data presents opportunities and challenges for e-commerce businesses, requiring a strategic approach to data quality, security, and compliance.
  • DSC Weekly 30 January 2024
    January 30, 2024
    by Scott Thompson
    Read more of the top articles from the Data Science Central community.