Learn about Data Analytics on the Digital Leaders topic page https://digileaders.com/topic/data-analytics/ We Lead Transformation Thu, 29 Aug 2024 17:15:22 +0000 en-GB hourly 1 https://wordpress.org/?v=6.8.3 https://digileaders.com/wp-content/uploads/2020/05/Plain-DL-Logo-150x150.png Learn about Data Analytics on the Digital Leaders topic page https://digileaders.com/topic/data-analytics/ 32 32 Everyone is a data leader—yes you! https://digileaders.com/everyone-is-a-data-leader-yes-you/ Thu, 13 Jun 2024 13:14:53 +0000 https://digileaders.com/?p=35356 Every leader is a data leader. I’ll say it louder for those in the back… EVERY leader is a data leader. From revenue and strategy teams to operations and people teams, there is no business function that can afford to not harness it’s functional and […]

The post Everyone is a data leader—yes you! appeared first on Digital Leaders.

]]>
Every leader is a data leader. I’ll say it louder for those in the back… EVERY leader is a data leader. From revenue and strategy teams to operations and people teams, there is no business function that can afford to not harness it’s functional and organisational data.

As I think back on my time leading fundraising for a nonprofit, I’m not sure I considered myself much of a data leader. But, in truth, I was utilizing data every day to steer decision-making that would ultimately positively impact our organization’s health and growth. In fact, I was likely the heaviest user of organizational data.

Data powered everything in my day-to-day, from helping me segment and send targeted messaging to donors based on preferred channels, to analyzing past giving patterns to predict when they’re likely to give again, to predicting future grant funds and event revenue so that I could plan accordingly. Data helped me track campaign performance and donor engagement, as well as show donors and foundations how their funds were impacting service population outcomes. I was able to tell incredible stories of long-term impact because of data collection and analysis. And, had I ignored what my data was telling me, I would have been aimless—instead defaulting to random gut-based decision making, unable to back up my decisions or make a case to shift away from long-held strategy beliefs.

No matter your job, data plays a critical role in both your individual success, and in the success of the organization as a whole. From influencing day-to-day decisions to informing long-term strategy, data is an essential resource to tap. And in today’s world, embracing data leadership is no longer optional — it’s a necessity.

 

The imperative of data leadership

In today’s digital age, data is generated at an unprecedented rate. Every interaction, transaction, and process produces valuable data points that, when analyzed correctly, can provide incredible insights, including opportunities for cost savings and new revenue streams. A McKinsey Global survey found that respondents at high-performing companies “are three times more likely than others to say their data monetization efforts contribute more than 20 percent to company revenues.”

Organizations that leverage data effectively are better positioned to outperform their competitors. A recent found that data-driven organizations are 23 times more likely to acquire customers, six times as likely to retain those customers, and 19 times more likely to be profitable. In an era where competitive advantage is fleeting, the ability to swiftly interpret and act on data can be the difference between success and failure.

 

Data leadership across business functions

Let’s dive into three business functions and how they benefit from harnessing their data.

  • Marketing: Personalization is no longer a luxury; it’s an expectation. By analyzing data from various touchpoints, marketers can gain a 360-degree view of their customers. This includes understanding their preferences, behaviors, and pain points, which in turn enables the creation of highly targeted and relevant marketing campaigns. Data allows marketers to tailor their messages to individual customers, improving engagement and conversion rates. According to McKinsey, companies that thrive at personalization earn 40% more money from these activities than the average competitor. What’s more, data-driven marketing provides clear metrics to measure the return on investment (ROI) of marketing campaigns. This allows leaders to allocate resources more effectively, optimizing marketing spend for maximum impact.
  • Sales: In sales, data is a powerful tool for identifying opportunities, improving customer interactions, and forecasting future performance. Data can help sales teams prioritize leads based on their likelihood to convert. By analyzing past interactions, demographics, and behavioral data, sales leaders can create predictive models that identify high-potential leads. Data-driven forecasting models can provide sales leaders with insights into future sales trends, helping them make informed decisions about resource allocation and target setting.
  • Strategy: Strategic decision-making is inherently data-driven. Leaders who incorporate data into their strategic planning can make more informed, forward-thinking decisions that drive long-term success. Data provides valuable insights into market trends, competitor activities, and customer needs. Strategic leaders can use this information to identify opportunities for growth and innovation. When it comes to team performance, data-driven performance measurement allows leaders to track progress against strategic goals. Key performance indicators (KPIs) and dashboards provide real-time insights into how well the organization is performing and where adjustments may be needed.

Read More Data & Decision Making

The post Everyone is a data leader—yes you! appeared first on Digital Leaders.

]]>
Digital is key to election, so must be digital poverty https://digileaders.com/digital-is-key-to-election-so-must-be-digital-poverty/ Thu, 06 Jun 2024 11:23:58 +0000 https://digileaders.com/?p=35343 After months, if not longer, of speculation, we now know – the General Election will be on 4th July. Arguably, more than ever before, digital will be more important than ever as we await the result. Why? Social media, of course – with diverse views, […]

The post Digital is key to election, so must be digital poverty appeared first on Digital Leaders.

]]>
After months, if not longer, of speculation, we now know – the General Election will be on 4th July.

Arguably, more than ever before, digital will be more important than ever as we await the result. Why? Social media, of course – with diverse views, but generally an echo chamber effect. Targeted messaging and advertising through different platforms. The role of data in gaining support. The spreading of news – and potentially fake news – online. In 2024, what’s an election without the debate and discussion that happens across digital platforms – whether that’s sharing your opinion on Facebook, following political commentary, or analysing data.

Unless you aren’t online.

If you aren’t online at all, you won’t be hit by the swirling news. In fact, you probably didn’t spend this afternoon receiving news alerts or debating with your team what the date would be, and arguably, you might not even know the election has been announced. Similarly, if you’ve run out of data or had to switch off your broadband due to rising costs.

And not only will you not know, but you won’t be sharing your views. With so many campaigns kicking off online these days, if you are digitally excluded, ironically, you’re not going to be able to spread the word about the need to tackle digital poverty. If you are one of the 11 million people who lack essential, basic digital skills, you may also be at greater risk of falling foul of related scams, of fake news – or purely struggling to register for new voter ID.

So, having established that digital plays a massive part in democracy these days, and given we already know that up to 19 million adults are in digital poverty, perhaps this tells us that tackling this exclusion – whether it’s through affordability, skills, or lack of trust or support – must be critical in the next governmental term, which will see us through all the way to 2029. So much has changed in the last five years, who can tell where we will be in the last year of the decade

 

This is why we have a simple manifesto call to all campaigning parties:

    1. Commit to creating a cross-departmental digital inclusion task force – across every department – with transparent accountability for real change and a joined-up focus.
  1. Take immediate action now, with meaningful communication campaigns that signpost support.

Why every department? Because digital touches every area of life. Education, health, welfare, jobs, rural services, housing – the list doesn’t end.

And why communications? Around two-thirds of people would improve their digital skills if there was free support. There is free support – but people can’t find it. Perhaps because they aren’t online, or perhaps because we want them to look in the places that society feels would be convenient, rather than taking the message to people.

 

How can I get involved?

Are you a candidate? Tell us if you support us. You can email me directly at elizabeth@digitalpovertyalliance.org. Tell your party you support action on digital poverty and want to see this included in campaign literature. If you need information about your constituency, we can share that information with you. Want to know more about how to support?

As well as the asks above, we are seeking greater awareness, support for affordability, increased accessibility of services, a dedicated skills programme and device access in schools, and greater support for local authorities to tackle digital inclusion. If you want to know more, drop me an email.

Are you working with a candidate? Tell them what you’ve just read. Ask them to get involved.

Are you a member of the public? Canvassing season is just beginning. Ask something different on the doorstep – ask about digital poverty. Ask both what the party is doing, but also what the local candidate is doing – whether that’s for the one in five children nationally in digital poverty, or the one in two families on low incomes who are digitally excluded.

Are you a business, perhaps with public affairs goals that align? Join our Industry Forum and be part of the industry response to helping millions of people access the online world – and your services – conveniently, safely, and effectively.

We sometimes hear digital considered a luxury, that it comes after other forms of poverty. A keyboarded device (laptop or tablet) with a stable internet connection isn’t a luxury. Without it, children can’t complete homework. Parents can’t access job opportunities (90% of which are only advertised online, and need a digital application). People can’t apply for benefits, healthcare, or other support. There’s a poverty premium – from insurance to driving licences, you pay more if you’re offline or struggle with accessing online services.

So, if someone tells you a phone is enough, ask them – could they do GCSE coursework on a phone with a cracked screen? And if they say no, ask them what they are doing to help.


Read More Digital Inclusion

The post Digital is key to election, so must be digital poverty appeared first on Digital Leaders.

]]>
Empowering a connected society https://digileaders.com/empowering-a-connected-society/ Tue, 04 Jun 2024 10:30:41 +0000 https://digileaders.com/?p=35341 As a leading telecommunication provider, we were chosen to develop living 5G and IoT laboratories for five Department for Digital, Culture, Media & Sport (DCMS) Create Projects. Through these projects, aql has enabled innovative partners through our Core IoT platform and 5G mobile network. We have deployed 5G networks and […]

The post Empowering a connected society appeared first on Digital Leaders.

]]>

As a leading telecommunication provider, we were chosen to develop living 5G and IoT laboratories for five Department for Digital, Culture, Media & Sport (DCMS) Create Projects. Through these projects, aql has enabled innovative partners through our Core IoT platform and 5G mobile network. We have deployed 5G networks and developed our IoT platform, collaborating with the Eden Project to help deliver the message of climate change urgency through the power of 5G. Our work with Mobile Access North Yorkshire and AMRC’s 5G Factory of the Future has seen us provide real-time environmental analysis to empower decisions in rural locations and to ensure optimal manufacturing conditions respectively. We further worked with Connected Cowes to bring high quality virtual reality footage and real-time telemetry to sailing regattas and Live + Wild to support real-time filming in extreme and remote environments. The millions of readings that are connected through our Core IoT platform have created living, breathing laboratories from which an incredible wealth of data can be drawn upon, analysed, and utilised to enact change across a breadth of industries.

As part of our mission to support the community and enable smart cities, we have leveraged IoT readings and our 5G mobile network to host hackathons throughout Leeds. These events have demonstrated to local businesses and educational institutions the transformative power of IoT and 5G technology through our Core IoT platform and mobile network, underscoring the pivotal role these technologies will play in the future of smart city tech.

For the Smart Cities Hackathon, we planned to incorporate our AI engine to open the event up to a wider selection of attendees with different technical competencies. To do this, we designed and built several AI assistants with knowledge of the hackathon’s challenges as well as our Core IoT platform so that they were able to provide guidance on all aspects of the event and our hardware.

The hackathon, organised in partnership with Nexus Leeds and Ingenuity Leeds, was held at the Nexus Building on the University of Leeds campus. It attracted a diverse group of participants from the University of Leeds, the University of HuddersfieldLeeds Beckett UniversityLeeds City College, and the general public.

Our strategic partners from AlliotDales Land NetLeeds City Council joined us for the event to support the attendees with real-world narratives to complement the IoT sensor readings. Alliot, as our IoT hardware partner, provided several different sensor types for the event including a selection of LoRaWAN and NB-IoT sensors. These helped demonstrate the different sensor technologies that can be connected through our wireless network services and managed within the Core platform. Our UK mobile roaming partner, Three, also attended the event, providing a signed Chelsea shirt to one of the hackathon winners as a prize. We also received promotional support from partners Digital Leaders.

With the help of our AI, attendees successfully completed a range of challenges, including enabling LoRaWAN and NB-IoT sensors, developing decoders and visualisations through the Core IoT platform, creating virtual sensors using the Core platform’s API, and developing custom data models using the wealth of sensor readings provided for the event. It was extremely rewarding to see how our AI was able to empower the various teams to understand and complete these challenges.

By the day’s end, several of the teams had completed a majority of the challenges, showcasing their ability to understand and utilise our smart city technology. The joint winners of the event, Chinonso Ani, and the Leeds Beckett University students Yuchi Lai, Meenakshy Liju and Hibah Khan, were given dongles and data SIMs from aql to allow them to continue exploring the day’s challenges.

Chinonso Ani, one of the joint hackathon winners.

Dr. Jackie Campbell with joint hackathon winners Yuchi Lai, Meenakshy Liju and Hibah Khan.

“It was great for our Data Science and Computer Science students to get hands-on experience of how sensors collect data, and how in turn, that data is used to inform and maintain our city. The technology at the hackathon ranged from maintaining roads and predicting floods to assisting the community by providing real time information. Smart technology is the future and we are excited to be part of it! Thank you for the opportunity.” – Dr. Jackie Campbell, Course Director – Data Science, Leeds Beckett University

Students from Leeds City College being assisted by aql developer Anthony Beckett.

“This was the second time our students have attended one of aql’s hackathons. The students loved getting to grips with the kind of technology they wouldn’t otherwise have any access to. For some of them, it has allowed them to see how careers in technology could be, and has inspired them to explore this kind of path for their futures.” – Rebecca Ashworth, Leeds City College 

Huddersfield University Students busy hacking.

“Our School of Computing and Engineering students were grateful to have an opportunity to use aql’s Core IoT platform, as well as access to real-life sensor data. Being given the chance to see how this kind of tech is used in the field, as well as being shown how to use it, was both useful and inspiring for them.” – Joshua McKeown, Student Experience Officer, Huddersfield University

aql VP Product & Development, Andrew Morris, delivering a talk at the event.

“This hackathon brought together a diverse group of partners and students from both further and higher education. It was incredible to witness the enthusiasm and energy of all the attendees as they tackled the complex challenges presented. The outcomes they achieved were truly impressive, and it was fantastic to see how they leveraged the hackathon AI to enhance their learning experience. This event was a brilliant showcase of how this technology can support future events, as well as our partners and customers.” Andrew Morris, VP Product & Development, aql

Chinonso receiving his signed Chelsea shirt from aql VP Product & Development, Andrew Morris

The Smart Cities Hackathon was a tremendous success. aql’s cutting-edge technology, combined with our partners’ data, offered young adults a unique opportunity to delve into IoT tech, smart city data, and AI. Through this event, we inspired the next generation to understand and engage with the transformative technology that drives change. We look forward to hosting future hackathons to inspire the next generation of technologists by giving them the opportunity to utilise cutting edge technology and real-world data.


Read More AI & Data

The post Empowering a connected society appeared first on Digital Leaders.

]]>
Data to see the future https://digileaders.com/data-to-see-the-future/ Thu, 09 May 2024 10:26:41 +0000 https://digileaders.com/?p=35097 For many companies, data wins start simple… albeit powerfully. Businesses invest in standing up baseline data foundations (e.g. data collection and storage, quality, literacy training, tools adoption etc.) so that they can start knocking out wins such as…. Establishing trackable KPIs/OKRs at departmental levels Using […]

The post Data to see the future appeared first on Digital Leaders.

]]>
For many companies, data wins start simple… albeit powerfully. Businesses invest in standing up baseline data foundations (e.g. data collection and storage, quality, literacy training, tools adoption etc.) so that they can start knocking out wins such as….

Establishing trackable KPIs/OKRs at departmental levels

Using dashboards and visualizations to convey data more powerfully

Increasing data literacy org-wide

Leveraging data to set direction and see what is and isn’t working

Creating a culture of accountability via monthly/weekly report outs

Huge and important wins!

But as companies advance along their maturity journey, how they want to win with data often starts to change. They begin eying things like AI/ML adoption and acceleration, progressive KPI-ing (more on that here), eliminated data siloes, data science, automated analysis delivery and… for many…

 

Predictive analytics. Or using data to shift from asking “what happened?” to “what might happen?”

At the simplest of levels, predictive analytics is about leveraging advanced analytics and modeling techniques to make predictions about the future… future outcomes, trends, customer behavior, macro events, organization performance, etc.

Companies can leverage predictive analytics across so many different domains and focus areas from answering questions about buying behavior to supply chain management to product development to risk management and so on. In fact, it’s become such a pervasive focus and investment of leaders across all domains that the predictive analytics market alone is expected to grow from $12 million in 2022 to $38 million by 2028.

So, what steps can you take today regardless of the functional area you support? Here are a few quick tips:

  • Data as Treasure: What role do you want data to play in your day-to-day? Do you want it to be a core team member whose main focus is to “report the news,” or share what happened? Or do you want it to be a treasure? Trustworthy, full of insight, and rife with untapped opportunity worthy of steering your future. The role you want data to play is in fact a choice. Because no mater the functional area you lead, once you decide the significance of data in shaping both your day-to-day and future objectives, you can turn attention to making sure data foundations are in place — storage, quality, governance, literacy, etc. — so that you can then leverage advanced analytics and AI/ML techniques to turn your trusted data into a treasure of possibility. Lean into your partnership with your data/tech peers (or a third-party provider) to ensure you are fortifying the core pillars of your data ecosystem so that you can pave the wayfor data to be a business treasure.
  • Think Like a Futurist: According to research from the Institute for the Future, as a human population, most of us naturally struggle to think about the “far future.” In fact, 27% of Americans rarely or never think about their lives five years from now, as compared to 60% who think about the near future — one month from the present — every day. As you reflect on your relationship with the future, consider how this might help or hinder how often you spend time pulling your team, department, or organization to the future. For example, do you spend more time reviewing historical or current data? Predicting no more than a few weeks out? Forecasting months and years out? As you shift towards prioritizing predictive analytics, see if you can also strengthen your personal focus on the future, channeling the mindset and behaviors of Futurists.
  • Identify and Aim: Instead of starting big — going from descriptive to predictive team or organization-wide — consider picking a specific use case against which having predictive analytics would greatly help. For example, do you most need insight into customer buying patterns? Pricing models? Risk mitigation? Cash flow? Product stickiness? Once you have your top use case identified, work with your data/tech teams on building specific models and analyses with the data you already have (or pinpoint the data you need to begin tracking) and start deriving insights for that specific opportunity at hand. Leverage this mini use case to establish the proof of concept and generate the momentum needed to then drive greater predictive analytics impact.

Your journey from descriptive to predictive can begin at any time. And it often just starts by asking one simple but powerful question… what might happen in the future with our business?


Originally posted here

Read More Data & Decision Making

The post Data to see the future appeared first on Digital Leaders.

]]>
AI Leadership: Learning to break free of the past https://digileaders.com/ai-leadership-learning-to-break-free-of-the-past/ Tue, 07 May 2024 10:16:10 +0000 https://digileaders.com/?p=35288 Sometimes it feels like I’m stuck in the past. Too often when faced with a new challenge, my first inclination is not to face forwards with an open mind, but to look backwards to try to extract lessons from previous experiences that help me to […]

The post AI Leadership: Learning to break free of the past appeared first on Digital Leaders.

]]>

Sometimes it feels like I’m stuck in the past. Too often when faced with a new challenge, my first inclination is not to face forwards with an open mind, but to look backwards to try to extract lessons from previous experiences that help me to describe and understand it. And while relying on what’s happened before can be very helpful in many circumstances, it also brings the real danger of being too blinkered, biased, or backward. I can’t work out if my past experience is my greatest asset, or the main anchor that holds me back.

It is a challenge that all of us face as we try to solve new problems, whether it is individuals reliving past glories, or organizations constraining innovation outside of existing cultural norms. We’ve all experienced it in one way or another: “Sorry, that’s not the way we do things round here!”.

Unfortunately, it is also a significant concern when looking to implement and apply AI. It sees the future through the eyes of the past. Despite the futuristic allure of AI, its intrinsic strength lies in the analysis of large amounts of historical data to extrapolate future scenarios. This approach raises important questions: Is AI overly reliant on the past in steering a course through an ever-evolving strategic and operational landscape? And if so, what are the implications for how we use AI to take us forward?

 

The strengths of AI’s backwards looking approach

The analytical prowess of AI, rooted in processing extensive historical data, shines a light on hidden trends, correlations, and anomalies that often elude human observation. To illustrate, consider AI’s role in enhancing many different kinds of forecasting capabilities. By scrutinizing past sales patterns, supply chain movements, customer behaviour, and market fluctuations, AI can predict future demand with an unprecedented level of accuracy. Such predictive insights not only optimize inventory management but also facilitate the personalized tailoring of marketing campaigns to individual preferences, build communities around shared products and services, and influence global trends.

Moreover, AI’s ability to streamline operations is exemplified through its analysis of historical performance data. This empowers organizations to identify operational bottlenecks, optimize production processes, and predict equipment failures. The result is a tangible improvement in efficiency and a reduction in downtime, underscoring the transformative impact of AI on industrial operations.

The innovation acceleration facilitated by AI is equally noteworthy. The mining of past research papers, patents, and industry trends enables AI to expedite the discovery of novel ideas, materials, and products. From designing new drugs to finding hidden deposits of raw materials, this newfound agility provides organizations with a competitive edge, illustrating how the well-tuned use of historical data can propel organizations and industries forward.

 

The pitfalls of relying on the past to predict the future

Yet, as we have seen all too clearly recently, predicting the future is fraught with challenge. While historical trends offer valuable insights, they can be particularly fragile when faced with the unknown. Of course, black swan events, like pandemics or technological breakthroughs, can shatter established patterns. However, often it is the more routine challenges that are a greater threat. Complex systems like platforms, markets, or societies are inherently dynamic, with countless factors interacting in unpredictable ways. As a result, even minor adjustments in starting conditions or small variations in the operating context can lead to wildly divergent outcomes, making precise predictions near impossible. While data is crucial for understanding the past and present, embracing the inherent uncertainty of the future is key to making informed decisions and navigating the uncharted waters that lie ahead.

Consequently, a nuanced understanding of the limitations inherent in AI’s past-dependence in its use of data is essential. A clear example is the potential introduction of data bias. AI algorithms trained on skewed or outdated data risk perpetuating existing biases and inequalities. For instance, a recruitment AI system may be trained on past hiring data that embeds cultural and corporate biases concerning candidates’ background, education, ethnicity, and gender. The risk is that the AI system might inadvertently replicate this bias in future recommendations, exacerbating imbalances within the workforce.

Another significant limitation arises from AI’s propensity to primarily extrapolate from existing patterns, rendering it less adept at predicting disruptive innovations or unforeseen events. A case in point is a large language model, like ChatGPT, trained on historical news articles. Such a model might struggle to accurately predict groundbreaking scientific discoveries or significant political upheavals due to its limited exposure to alternative possibilities beyond historical data.

Furthermore, an overreliance on AI predictions has been seen to foster a false sense of certainty among decision-makers. It is crucial for leaders to remember that predictions, despite their precision, are still probabilistic in nature, necessitating a balanced approach that considers alternative perspectives.

 

AI’s black box

Underlying this challenge is often a poor understanding in leaders and decision makers of the fundamental concepts of AI and data science. Hence, many people beginning to rely on AI systems have little meaningful understanding of what’s inside the “AI black box”. A deeper scrutiny of AI’s use of data for prediction exposes several important principles that must be recognised by anyone involved with the responsible use of AI:

  • Correlation is not causation. AI excels at identifying correlations within data but often falters in comprehending the underlying causal relationships. Whether it is the correlation of ice cream sales with sunburn, or Asthma patients recovering faster from pneumonia, while the correlations exist, they do not imply a causal relationship, and relying on such correlations for decision-making can lead to erroneous conclusions.
  • Extrapolation hampers innovation. AI’s proficiency in identifying patterns and extrapolating from existing data proves invaluable for short-term predictions. However, this very attribute reduces its capacity to anticipate truly disruptive innovations or paradigm shifts. An AI trained on data related to a narrow set of solution approaches may limit its understanding and cause it to overlook the transformative potential of new ways to address problems.
  • Missing variables and hidden biases skew data. Even within the most comprehensive datasets there are gaps. Despite the extensive nature of the data, these omissions can significantly impact the accuracy of AI predictions. For instance, an AI trained on job applications from a specific region, ethnicity, or culture may inadvertently favour candidates that reflect these characteristics, potentially overlooking qualified individuals from diverse backgrounds.
  • Garbage in, Garbage Out. The quality of AI predictions is intrinsically tied to the quality of its training data. Utilizing flawed, incomplete, or outdated data inevitably leads to unreliable and potentially harmful outcomes. Social media is particularly prone to this. For example, AI trained on a dataset that includes extreme language and hate speech can inadvertently amplify harmful narratives, exacerbating social division.
  • Beware of overfitting. AI’s attempts to find patterns in data underscore the potential illusion of certainty created by AI algorithms. These algorithms may perform exceptionally well on training data but fail to generalize accurately to new data, leading to misleading conclusions and decisions. Under pressure to obtain precise responses, issues such as overfitting require careful consideration.

When the past misleads: The lessons from covid

The COVID-19 pandemic serves as an illustrative case study, demonstrating how reliance on pre-pandemic data can lead to misleading predictions. Consider the fragility of AI-supported supply chains as they struggled to cope during the pandemic. Due to drastic swings in production, surges in demand, and re-design of supply chains, AI predictions during that period varied widely from the new business reality. While seemingly logical, both during and post-pandemic, shifts in product production and consumer behaviour frequently rendered such predictions entirely inaccurate.

This scenario underscores several potential pitfalls. Firstly, the occurrence of unforeseen events, such as the pandemic, can significantly impact markets and behaviours. AI models trained on pre-pandemic data lack the context to understand and predict such shifts, highlighting the limitations of past data in foreseeing unprecedented events.

Secondly, the concept of temporal bias must be addressed. Data collected during specific periods may not be representative of long-term trends. Predictions based on data influenced by the pandemic might not hold true in a post-pandemic world, emphasizing the importance of continuously updating and refreshing training data.

Finally, the contrast between static and dynamic environments becomes evident. The world is in a constant state of flux, with AI models rigidly reliant on past data potentially failing to adapt to changing market conditions, consumer preferences, and unforeseen disruptions. Similar to technical debt in software, data debt in AI systems can be equally corrosive.

 

Breaking free of the past

Overcoming AI data limitation issues is far from easy. To navigate through these intricate challenges, digital leaders must adopt a strategic and proactive stance to data management, including:

  • Embracing data diversity and remaining vigilant is paramount. AI systems should be trained on diverse, up-to-date datasets that encapsulate the ever-evolving intricacies of the world in which they operate. Moreover, leaders must actively monitor for potential biases, ensuring fairness and accuracy in the predictions generated by AI models.
  • Human-AI collaboration is central to effective deployment of AI. Digital leaders should view AI as a powerful tool that complements human judgment rather than a replacement for it. The synergy between AI’s predictive capabilities and human ingenuity is key to navigating complex situations and exploring uncharted territories.
  • Embracing experimentation and agility is crucial. Rather than being tethered to past successes or failures, digital leaders must foster a culture of experimentation and agile decision-making. This adaptability is indispensable for organizations to navigate rapidly changing market dynamics and seize unforeseen opportunities.

To be effective, a deeper understanding of AI’s use of historical data is critical. While looking backwards remains a cornerstone of AI’s predictive capabilities, it should not dictate our vision for the future. By acknowledging and actively addressing the limitations inherent in AI’s reliance on historical data, organizations can unlock its potential and take a more responsible approach to the use of AI to lead them forwards.


Read More AI & Data

The post AI Leadership: Learning to break free of the past appeared first on Digital Leaders.

]]>
Open data’s unmet promise and its impact on Scotland’s local democracy https://digileaders.com/open-datas-unmet-promise-and-its-impact-on-scotlands-local-democracy/ Thu, 02 May 2024 11:05:09 +0000 https://digileaders.com/?p=35273 Over the last 10 years, the discussion on open data has gained significant traction in the UK. Open data was championed as the key to unlocking transparency, driving efficiencies, and delivering real-world outcomes. However, the issue of open data’s usability is often overlooked. After all, […]

The post Open data’s unmet promise and its impact on Scotland’s local democracy appeared first on Digital Leaders.

]]>
Over the last 10 years, the discussion on open data has gained significant traction in the UK. Open data was championed as the key to unlocking transparency, driving efficiencies, and delivering real-world outcomes. However, the issue of open data’s usability is often overlooked. After all, merely making digital information available doesn’t guarantee its practicality or accessibility. This reality was highlighted by the obstacles encountered by my team at Zühlke during our recent investigation into Scotland’s transport network

After diving into the seemingly ‘open’ datasets across the Scottish transport network, what we found did not embody ‘openness’ at all. Outdated datasets, unstructured information, and missing data were all major obstacles to carrying out effective analysis and problem-solving.

But don’t assume this is a technical problem. These challenges have real-world consequences that impact people’s everyday experiences. 

A notable example is the impact on public transport journeys, particularly to and from rural Scotland, where the lack of connectivity between transport providers leads to significant waiting times.

The challenges we encountered during our research extend beyond technical difficulties– they have a direct impact on democracy at the grassroots level.

Imagine a scenario where community activists want to improve local transport links, advocating for changes in bus/ferry/train schedules and enhanced connectivity between various modes of transportation. How can they substantiate their arguments if the relevant data is inaccessible or unusable?

In the context of Scotland, the consequences of this data usability gap become even more significant. Long waiting times between connections, as we’ve illustrated through our examination of transport schedules, compound the challenges faced by locals. Not only do they directly suffer from poor scheduling, but they are also unable to do anything about it. So, this is not merely a matter of convenience; it’s about fostering a space where citizens can actively participate in discussions that impact their daily lives.

In Scotland, the focus must shift towards making data usable, ensuring that it empowers local communities rather than hindering their efforts. By doing so, we will lay the foundation for a more transparent and accountable democracy, where citizens have access to the information necessary to actively participate in decisions affecting their daily lives.

Let’s move beyond the general rhetoric of open data and focus on making it truly accessible and usable for the citizens it aims to serve. By connecting the dots between open data challenges and their real-world implications, we pave the way for a future where local democracy thrives, powered by transparent, accessible, and usable data.


Originally posted here

Read More GovTech

The post Open data’s unmet promise and its impact on Scotland’s local democracy appeared first on Digital Leaders.

]]>
Debunking misconceptions about LLMs in data and analytics https://digileaders.com/debunking-misconceptions-about-llms-in-data-and-analytics/ Tue, 30 Apr 2024 09:08:33 +0000 https://digileaders.com/?p=35266 I’m a big advocate for Generative AI (GenAI) and Large Language Models (LLMs) and they’re potential benefits. But with all the buzz, it’s easy to get caught up and misunderstand what these technologies can really do, especially in the world of data and analytics. There’s […]

The post Debunking misconceptions about LLMs in data and analytics appeared first on Digital Leaders.

]]>
I’m a big advocate for Generative AI (GenAI) and Large Language Models (LLMs) and they’re potential benefits. But with all the buzz, it’s easy to get caught up and misunderstand what these technologies can really do, especially in the world of data and analytics.

There’s certainly been some overselling going on, and people need to know what the common misconceptions are, and why people are key to GenAI and LLMs producing the results we need. 

 

“The copilot will sort it”

More and more software vendors are integrating copilots into their data and analytics platforms to turbocharge development, smooth out code migration, and dish out automated insights. This is all great, but these tools do not provide a one-size-fits-all solution and it’s important to remember that. It’s crucial to grasp their limitations before rolling them out to users and understand that you’ll still need developers in the trenches crafting applications.

Copilots can do a range of great and really helpful stuff, one being automatically building reports with built-in insights and anomaly detection. But while features like this are useful, the reality is you can’t just sit back and trust that these reports are flawless. You’ll need to double-check that all the filters and definitions are spot-on to guarantee 100% accuracy. This means every report churned out by copilots will need a human expert’s stamp of approval before it’s rolled out.

 

“The LLMs can do the maths for us”

These solutions are designed to be like neural networks that mimic the astonishing capabilities of the human brain. But as amazing and as powerful as our brains are, we’re not calculators, and neither are LLMs.

Just like us LLMs are prone to mathematical slip-ups, so banking on them for 100% accuracy is a big gamble. They do shine when it comes to handling basic number crunching on smaller data sets, like your run-of-the-mill sums and averages. But if you’re thinking they can tackle complex mathematical tasks like forecasting or intricate what-if analyses, you’ll be left disappointed.

If we want LLMs to work effectively with our data, it’s wise to have people spoon-feed them pre-summarised and pre-calculated information. That way, we minimise the chances of any mistakes occurring.

 

“We can move on from data analysts”

LLMs are becoming increasingly popular as a way to provide commentary on our data. This is because they excel at condensing information into neat summaries and even spotlighting interesting points and outliers.

However, they’re only as good as the data we feed them, and the amount of information we can share is relatively modest compared to most databases.

At the same time, if we try to use LLMs to produce commentary that involves its base model, such as its internet knowledge base, we risk creating hallucinations where the platform makes up its own story. 

We also can’t yet rely on them to be experts in our fields. They won’t always have the insider knowledge or grasp all the ins and outs that matter when explaining our data unless a human analyst steps in to fill in the blanks  

In summary, while LLMs can help us tell a story with our data, they’re not a one-stop shop and we’ll still need a trusty data analyst to manage and oversee this process.

 

“We can get rid of our databases”

Theoretically, we should be able to place an LLM on top of all our data and ask it questions, removing the need to write SQL queries. For those one-off inquiries, this can work well. Need to know the status of order 12345? LLMs should be able to answer that with minimal effort.

Challenges can arise though because these solutions can only process small amounts of data at a time. So while they can handle questions about individual records, throw in a more complex query like “What’s my total order value?” and they can then hit roadblocks. They would need to scan through loads of records to find that answer, which would exceed the LLM’s input limits, meaning we would get a result, but it would probably be incorrect.

They would also not know how to calculate and apply precise business definitions that often exist within data models or be able to process complex relationships.   

 

“Generative AI can generate our charts”

GenAI can create sample code, but this doesn’t mean we can use it to accurately generate code to produce a chart. These platforms would only be able to give us some sample code which we can’t guarantee will work.

It’s the same with images. GenAI can create imaginative images like a cat driving a car, but can’t generate something specific like a bar chart with 15 different bars and labels. For example, if you asked a GenAI platform to produce an image containing a company’s logo, it would generate something that looks similar to that organisation’s branding, but it wouldn’t be a perfect copy. 

When it comes to data and analytics, these tools are text wizards, not miracle workers. You’ll still need the human touch to turn their output into something truly useful.

 

“ LLMs can fix all our data quality issues”

LLMs can help us manage issues around data quality. Take “Eurpe” for instance; they’ll spot that typo and correct it with minimal fuss. 

However, LLMs aren’t well suited to dealing with large volumes and are not subject matter experts who can natively understand all the nuances within your information.

Lastly, these tools are trained on what’s out there in the digital ether, they’re not equipped to handle what doesn’t exist or the unknown. They will struggle to identify incomplete data.

 

People and technology in harmony

GenAI and LLMs already have many impressive capabilities that can work wonders when used wisely. But it’s important to remember they can’t replace the vital jobs that developers, analysts, databases, and BI tools do. People, with their expertise and insights, remain the unsung heroes ensuring these technologies hit the mark and drive organisational success. It’s a team effort, with humans and AI working hand in hand to unlock the full potential of data and analytics.


Read More AI & Data

The post Debunking misconceptions about LLMs in data and analytics appeared first on Digital Leaders.

]]>
UK essential services: practical steps to enhance support for people in vulnerable circumstances https://digileaders.com/uk-essential-services-practical-steps-to-enhance-support-for-people-in-vulnerable-circumstances/ Thu, 11 Apr 2024 10:51:59 +0000 https://digileaders.com/?p=35191 Amid UK’s cost of living crisis, effectively supporting the most vulnerable groups must be a priority. Read on and discover our suggested roadmap to establishing an ethical data ecosystem to support consumers in vulnerable circumstances. The UK is facing a major cost of living crisis. […]

The post UK essential services: practical steps to enhance support for people in vulnerable circumstances appeared first on Digital Leaders.

]]>
Amid UK’s cost of living crisis, effectively supporting the most vulnerable groups must be a priority. Read on and discover our suggested roadmap to establishing an ethical data ecosystem to support consumers in vulnerable circumstances.

The UK is facing a major cost of living crisis. Many households are struggling with their rent or mortgage payments, forced to tighten discretionary spending and resort to desperate measures like unplugging fridges to cope with rising bills.

Right now, effectively supporting the most vulnerable groups across the country must be a priority.

Enter Citizens Advice, a UK-based, independent, consumer charity that specialises in providing advice and assistance to people with legal, debt, housing, and similar problems. Their ground-breaking “Closing the Gap” report outlined their vision for improving consumer support in essential services.

The report shed light on the inadequacy of the current approach to data sharing among essential service providers like energy, water, telecoms, and financial companies. It stressed that the customer journey of accessing support is way too complex and disjointed, resulting in people missing out on the support they are entitled to. Additionally, the report outlined what a better system could look like, one that bridges the gap between the support people need and the support they receive.

Early last year, our team conducted Innovate UK-funded research, investigating the value and opportunities of effectively working with permissions data that describes individuals’ preferences for the use of their personal information.

To continue exploring the subject with industry peers, we held a co-creation session in collaboration with the Open Data Institute (ODI). At the workshop, the topic of supporting vulnerable groups emerged as a priority and sparked a passionate discussion about the ways in which open and therefore trustworthy data ecosystems could facilitate ethical data sharing and improve the current system.

In the interest of furthering progress, we’ve collated the learnings from Citizens Advice’s report, the co-creation session, and our Innovate UK research on personal data sharing.

As Citizens Advice point out in their report, more needs to be done to ‘revolutionise the way people access support’ and to ‘achieve a solution that can be used by providers across all essential service sectors’. To do so, Citizens Advice suggests that government intervenes by assembling an ‘Essential Services Industry Taskforce’ that includes key stakeholders like the Information Commissioner’s Office, National Government, Ofgem, Ofcom, Ofwat, the FCA, and Citizens Advice itself.

In support of this vision and to accelerate coordination, we’ve outlined a practical roadmap to help explain what activities such a taskforce should prioritise to make the Citizens Advice vision a reality and improve support for vulnerable groups through ethical and collaborative data sharing.

 

Roadmap to an ethical data ecosystem to support consumers in vulnerable circumstances

Our suggestion is a three-stage process – learn, design, prototype – however, we do not expect this to be a linear journey. For example, prototyping will stimulate new design work and designing will create a need for additional learning.

Fundamental to success will be the inclusive and continuous information sharing among the direct participants of the data ecosystem and with the wider range of stakeholders who have strong opinions over how essential services should operate. This is essential for earning trust in the ethical use of individuals’ personal data within these services and ensuring their willing consent.

Here’s what the three-stage process would look like:

Essential services industry Taskforce ethical data ecosystem roadmapFigure 2: Suggested roadmap for an Essential Services Industry Taskforce to establish an ethical data ecosystem to create simple and controllable support services for consumers in vulnerable circumstances.

1. Learn

This step has already begun as Citizens Advice outlined key essential services and government departments that’ll have to work together. Our co-creation session provided more details on the relevant types of organisations that need to be included:

  • Central government and local authorities
  • Emergency services
  • Debt collection agencies
  • Water and energy networks
  • Energy retailers
  • Social care services
  • Mortgage providers and insurance companies
  • Private rental sector
  • Schools and colleges
  • Retailers and pharmacies
  • Food banks and charities

These stakeholders will have to agree on the detailed scope of their shared mission, collectively understand their policies and the wider governance they follow, and characterise the technical systems and services they currently use to support those in vulnerable circumstances. This might mean sharing current organisational policies on vulnerable consumer support and use of instruments such as data sharing agreements and system-level data contracts.

To ensure inclusive progress for a broader range of stakeholders, it’s important to make this information accessible both to the taskforce and to the public, benefiting a wider audience.

Discovery of vulnerable customer registers

Several areas of research will need to take place, including collating existing initiatives to coordinate services. Customer registers should be a topic of particular interest.

There is no single source of truth for consumer identity between organisations. Energy companies, the NHS, GP surgeries, the DWP, and others all have their own lists; these registers are each operated and formatted differently to one another and will be using identifiers that don’t reliably correlate across organisations. So, a major challenge that the taskforce will face is gaining the technical ability to reliably identify consumers who are in vulnerable circumstances and doing so in a coordinated way across essential service providers.

For example, while the NHS number is often considered a reliable identifier, it’s not used universally. An energy company or a bank is unlikely to have its customer’s NHS number. This identification uncertainty is a significant hurdle when attempting to link registers between organisations.

Despite the challenge, unravelling the intricacies of integrating different registers to enable consensual identification is a critical step toward creating cohesive and effective essential services. Discovering the exact technical status of essential service providers’ registers is a crucial foundational step that will baseline current capabilities (including learning about register data formats, data quality, data sources, data exchange mechanisms and associated data contracts and service policies).

 

Listing of data sharing agreements and mechanisms

As a baseline of existing services and technical systems emerges, the taskforce will be positioned to digest current arrangements and agree on a sector-wide vision for how services across essential service providers should work. We recommend that this vision setting is conducted both at a policy level and on a technical level to ensure that ‘what’ policy agreements plan to achieve is realistic and pragmatic in terms of ‘how’ these plans can be realised.

Again, as is our view across the taskforce’s work, we recommend that work is carried out as openly as possible, with progress and plans continually published publicly to ensure inclusivity and trust by the very large ecosystem of stakeholders who will need to coordinate to improve essential services.

2. Design

During this stage the taskforce will need to review the assembled information to determine how to adapt essential services for better coordination. We expect this to require a strong focus on both cross-sector policy alignment (such as service requirements across utilities and banks) and data interoperation for technical integration of services. Specifically, the ability to coordinate consumer identification across essential service providers automatically, at a large scale (for millions of people), and in a way that is ethical and fully controllable from the perspective of the consumer is imperative.

Focus on data over digital technology will ensure that taskforce solutions are adaptable to suit all stakeholders in the ecosystem (metadata, data spines, data models, API end-point contracts). Review of policy and regulation will help understand where governance is blocking progress or can accelerate investment into what we expect will be a newly emerging standard for ethical personal data permissions sharing.

At the design stage, the taskforce will need to create a common data architecture –  one that strikes a balance between ensuring a complete service is developed, and preserving the autonomy of participating organisations to get on with building their own services. This means, the taskforce will likely have to agree on the following features for data usage:

  • semantics used when gaining consumer permissions (such as consent)
  • metadata to clarify definitions and align data formats
  • data models to standardise how permissions integrate together
  • data sharing agreements for swift communication to identify people in vulnerable circumstances in operational contexts
  • data policies that pinpoint opportunities to harmonise regulation across sectors

Creating these features will help inform the development of a shared data architecture for effective integration of essential services for consumers in vulnerable situations. If the taskforce can achieve this, then it will be ready to move from the initial discovery stage to alpha and beta stage of testing and implementation.

3. Prototype

Achieving rapid progress requires prototyping early and often. In our roadmap, we’ve sketched what this might look like, but in reality, the design stage will strongly inform  how best to proceed. In general, highly engaged stakeholders should be encouraged to partner and lead on the testing and learning of optimal ways for exchanging data between their organisations. This will allow the taskforce to validate that emerging shared data architecture can scale across an extensible data ecosystem.

Implementation will require a shift from the data layer to the digital and technology layers. At this point, proofs of concept (PoC) will be taking centre stage as well as the selection of appropriate tools and solutions. For scalable success, architecture principles should be adhered to, guiding the use of technology. We expect tactical needs to deviate from this and so effective programme management will become key.

There will likely be a need to establish ‘run-ahead teams’, comprised of organisations that are developing compatible registers and adhere to the taskforce’s architecture principles. These groups will pioneer data integration approaches and validate that those in vulnerable conditions are better supported across the ecosystem as a result.

As PoCs evolve, we expect a growing emphasis on analytical topics, such as techniques for the matching and linking of data sets to identify vulnerable consumers across organisations. Additionally, we also expect the need for test exercises that address specific use cases, such as tracking consenting individuals through their changing circumstances to offer better support as their vulnerability needs evolve.

Importance of maintaining a knowledge base

We have emphasised the need for the open sharing of taskforce’s progress, but this topic requires further attention. Since a lot of work will be happening in parallel among a very large group of stakeholders, the taskforce needs to be capable of scaling up its own work to sustain progress as more and more essential service organisations participate. So, as the tasks outlined above are getting done, we recommend establishing an open-source knowledge base to communicate progress, developments, and decisions inclusively and quickly as they emerge. This will be complex and require its own governance to achieve coordination at a large scale.

Data ecosystems perform best when knowledge is shared between participants. To best respond to this complex social challenge, we recommend knowledge bases are ‘presumed open’ by default for everyone to have open access.

Within the knowledge base, the key stakeholders need to be listed, details of the agreed scope documented, existing initiatives summarised, relevant regulations outlined and sign-posted, and the final vision published.

In short, the knowledge base should be viewed as a key part of the entire project and continuously added to. It will enable smoother collaboration and a 360° view of the consumer support in essential services landscape. Plus, it’ll improve the ability of the industry and other initiatives to self-service their own efforts, picking up precisely where this taskforce work ends, minimising gaps, and overlap between initiatives. It will serve as a shared blueprint and plan for UK’s essential services sector.


originally posted here

Read More GovTech

The post UK essential services: practical steps to enhance support for people in vulnerable circumstances appeared first on Digital Leaders.

]]>
Accelerating and de-risking the development of scaled, resilient, and connected national safety services https://digileaders.com/accelerating-and-de-risking-the-development-of-scaled-resilient-and-connected-national-safety-services/ Wed, 14 Feb 2024 12:37:23 +0000 https://digileaders.com/?p=35118  Inter-Agency Collaboration Gains Through Data Culture Transformation and Change 2024: The World continues its transition towards more resilient, sustainable growth following three years of healthcare threat, which in part have been a catalyst for economic and societal, turbulence. Our own experience at Informed during this […]

The post Accelerating and de-risking the development of scaled, resilient, and connected national safety services appeared first on Digital Leaders.

]]>
 Inter-Agency Collaboration Gains Through Data Culture Transformation and Change

2024: The World continues its transition towards more resilient, sustainable growth following three years of healthcare threat, which in part have been a catalyst for economic and societal, turbulence.

Our own experience at Informed during this challenging time has seen us in the privileged position of driving and supporting digital change and developing data-led resilience and sustainability services for nationally and internationally-significant public safety, civil defence, and healthcare programmes in support of The Home Office, The National Police Coordination Centre (NPoCC), The NHS Patient Safety Team and most recently the UK Health Security Agency (UKHSA), where we are helping the organisation mature its digital operating model in the aftermath of the Covid pandemic.

Although each of these engagements have different objectives, they state the importance of safe and effective data sharing between agencies for effective collaboration as a common, critical theme. Whether that be capturing and sharing patient incident data across the NHS estate for patient safety improvement, or in capturing data on every fire-related incident into a national reporting system that helps fire and rescue services understand the leading causes of fires in order to reduce fire related casualties.

Our work with the National Police Coordination Centre has seen the advancement of Intelligence-led policing through the development of a cloud-based data integration and digital mutual aid platform that integrates nine regions and 46 police forces, providing superior operational preparedness and response for national scale operations. 

And with the UKHSA, the body responsible for protecting our communities from the impact of infectious diseases, chemical, biological, radiological, and nuclear incidents, and other health threats, our team is helping the agency’s technology arm design, develop, deliver, and support the technology required to prevent, detect, analyse, monitor, and respond to public health threats across the UK. 

Through our work with the teams responsible for critical national infrastructure, we have seen first-hand a very real requirement for continued, smart investments in data sharing capability and capacity that enables and empowers resilient inter-agency network collaboration.

To realise an effective, seamless inter-service collaboration vision, agencies have to provide the integration, collaboration, communication, and information sharing needed to serve both operational staff delivering a service and the needs of citizens and patients these services  must meet. This ability to share and collaborate will enable effective service and safety for citizens wherever and whenever they need it most, and where challenge and need can be most effectively met. This will rely on more of a whole system approach to inter-agency collaboration based on effective data and insights sharing.

While some agencies are trailblazers in the use of data, digital tools and technology, others may lag in their journey of due to the challenges of legacy data estates, leaving data preparedness and readiness the next challenge to address ahead of digital service integration and collaboration.

The quality of data and the ability to share will underpin a more effective (and cost effective) transition to intelligence-led policing, emergency services and healthcare, and each service’s ability to collaborate. The key will lie in the ability for each agency to exchange and interrogate high-quality data, using information transferred within networks in order to make the best, most effective, and most timely decisions about what care, communication, or support is delivered, as well as where and how.

With existing levels of fragmentation and divergence across the NHS and Justice estates, interoperability remains a fundamental building block for new digitally enabled shared services. An effective and interoperable data sharing ecosystem will provide an infrastructure that uses technical standards, policies, and protocols to enable seamless and highly secure capture, discovery, exchange, and utilisation of information, with appropriate controls that ensure proper and effective use. Alongside this, the reshaping of legacy systems with platforms that communicate with, and work better together, can be used to more effectively access and share data.

This ecosystem must also better meet the challenge of sharing unstructured data by employing Artificial Intelligence (AI), Machine Learning (ML) and Natural Language Processing (NLP) techniques to discover and provide relevant information at the point of interrogation and use.  This approach offers significant potential for data sharing, as it allows more meaning and intelligence to be extracted from legacy and unstructured data, and can also support better assessment of data quality and confidence levels in real time, by for example attempting to correlate between different data sets.

In meeting this challenge, data scientists at Informed have worked over the past two years to develop InformedDECISION© – an innovative, first of its kind AI-based decision support platform that enables decision makers to categorise and extract meaning from large, distributed, and unstructured data sources in real time to support and enhance complex decision-making. Importantly, the platform’s ability to unify and extract value from existing unstructured data sources without the need to upgrade systems or take copies of the data could provide a short cut to immediate efficiency and collaboration gains for inter-agency collaboration, whilst significant legacy and data quality challenges are addressed.  The platform is already helping Medical and Environmental decision makers integrate and make sense of large, distributed datasets in real time, employing automated learning to better understand and qualify external datasets as they are used. 

This platform can integrate intelligent workflows that adapt to users’ needs and support complex requests and transactions, with multi-agency case handling delivering seamless and secure case transaction management across multiple organisations through API bridges that efficiently integrate and harmonise data.

As a two-time Queen’s Award for Innovation winner for our ability to accelerate and de-risk digital business change, we understand that the levers that help overcome the challenges of inter-agency collaboration through data sharing across estates lie in; the potential for AI to improve integration of unstructured data; shared and open technical standards that facilitate effective data interoperability; and ultimately investment in quality, decision grade data to support current and future needs.


Read More AI & Data

The post Accelerating and de-risking the development of scaled, resilient, and connected national safety services appeared first on Digital Leaders.

]]>
The Secret to AI, the Universe, and Everything: Learn to ask better questions https://digileaders.com/the-secret-to-ai-the-universe-and-everything-learn-to-ask-better-questions/ Sun, 11 Feb 2024 10:51:25 +0000 https://digileaders.com/?p=35113 I needed cheering up. With so many dark and disturbing stories in the news these days, I decided that I should escape for a while and remind myself of happier times by spending a few hours on the sofa under a duvet re-reading Douglas Adam’s […]

The post The Secret to AI, the Universe, and Everything: Learn to ask better questions appeared first on Digital Leaders.

]]>

I needed cheering up. With so many dark and disturbing stories in the news these days, I decided that I should escape for a while and remind myself of happier times by spending a few hours on the sofa under a duvet re-reading Douglas Adam’s wonderful series of “Hitchhiker’s Guide to the Galaxy” books. Taking me away from today’s pressing problems and into another world where anything and everything is possible.

Cult classics when they were originally written in the late 1970’s, it was great to reconnect with the crazy characters and their adventures in Adam’s books. Although to be honest, some of the material (or perhaps it is just me) has not aged too well. What seemed fresh and original more than 40 years ago is much less so today. Nevertheless, the central theme of these works and the genius of their key premise remains as fresh and captivating as it ever did. And in a new age of AI, it is perhaps even more relevant today than it was all those years ago.

 

Deep thought’s dilemma: Why the Answer is just the beginning

In Douglas Adams’s “The Hitchhiker’s Guide to the Galaxy,” the supercomputer Deep Thought famously calculates the answer to the ultimate question of life, the universe, and everything: 42. But, as the story unfolds, the real challenge turns out to be not the answer itself, but rather the question that Deep Thought spent millions of years processing. In fact, figuring out the right question to ask is far more critical than simply seeking the perfect answer.

This sentiment resonates deeply with my experiences when considering the current state of AI. We’re bombarded with data, impossibly complex algorithms perform billions of calculations, and mountains of academic papers and reports promise new insights. Yet, there are worrying reports that data management practices are out of controlfinding meaning in the vast data sets is getting harder, and  many AI projects underperform, failing to deliver the transformative results expected.

Perhaps, like Deep Thought, we’re focusing too much on the answer and neglecting the crucial first step: asking the right question. In the world of AI, success hinges not on finding the “42” in our data, but on meticulously crafting the questions that unlock its relevance, meaning, and potential. It may be this critical shift, exploring how to focus on better questions, not just better answers, that can pave the way for more meaningful AI success in your organization.

 

Data-driven everything

With the rapid advances in AI, the allure of data-driven decision-making is undeniable. In an era where information flows freely, excitement surrounding AI focuses on the ability to quantify and analyze what previously seemed obscure and unmanageable. AI seems to hold the key to unlocking optimized solutions in almost every domain we can imagine. However, a singular reliance on “getting the data” can create a mirage of clarity, masking the critical role of context in interpreting and applying information effectively.

Hence, while much of the AI hype may indeed turn out to be justified, those of us involved in complex digital transformation scenarios also recognize that there are many potential pitfalls of these data-centric approaches if we don’t acknowledge the fragility of decision-making when the bigger picture is neglected.

Consider the example I faced recently when working with a multinational organization implementing a data-driven inventory management system across its global supply chain. The algorithm, optimized for efficiency, had been delivering great result in streamlining production and reducing stockpiles. However, as the context in which it operated became less consistent or predictable, it failed to account for local variations in demand, infrastructure limitations, and cultural nuances in distribution channels across the globe. The result? Delays, stock shortages, and ultimately, dissatisfied customers. This stark scenario brought home to me the crucial role of context in understanding data and its implications. They’d been focused on the wrong questions.

The rush to “data-driven everything” must be aligned with an important reality: Data, in its raw form, is merely a collection of facts. It is the interpretation and application of these facts, informed by a nuanced understanding of the surrounding circumstances, that yields truly valuable insights. As we have seen time and time again, ignoring the context – the cultural factors, logistical realities, and unforeseen variables – can lead to seemingly efficient decisions that unravel in the face of real-world complexities. Nowhere is this being seen more clearly than with Generative AI tools based on Large Language Models (LLMS) trained somewhat indiscriminately on data pulled from across the internet. Real-world data, especially text and images scraped from the internet, is riddled with bias, from gender stereotypes to racial discrimination.

To address this, digital leaders and decision makers require a deeper understanding of the limitations of data-driven decision-making in isolation. They must delve into the root causes of data misinterpretations, and develop practical strategies for incorporating context into the decision-making process. In particular, they should realize that data is a powerful tool, but it is only when wielded with an understanding of the bigger picture that it leads towards informed and sustainable solutions.

 

Why start with why?

A good place to start in understanding how to use data is to recognize that the key question in any data-driven scenario is not to focus on “what” or “how”, but to start with “why”. Something that was highlighted some years ago in the work of business guru Simon Sinek.

Although originally targeted at much broader business strategy concerns, Simon Sinek’s call to “start with why” holds immense relevance in the data-driven landscape of AI. His argument centres on the idea that people connect with purpose, not just products or services. Businesses that communicate their “why” – their core values, beliefs, and motivations – cultivate deeper relationships with customers, employees, and stakeholders.

In the context of our AI-driven digital age, “starting with why” translates to understanding the purpose behind data collection, management, and analysis. Going beyond mere data acquisition, it emphasizes extracting meaningful insights to solve real problems and create positive impact. Whether in smart buildings optimizing energy useconnected cars enhancing road safety, or wearables enabling personalized healthcare, the critical challenges for digital strategy involve much more than numerical analysis and statistics. They require interpretation of that data in situations that are frequently volatile, uncertain, complex, and ambiguous (VUCA).

Consider any dataset that you are using today. I would argue that using that data to drive automated decision making in an AI scenario could be viewed as irresponsible without recognizing basic concerns such as;

  • What data do we collect and how often? To what accuracy?
  • What data do we decide to keep or throw away?
  • What meta-data is needed alongside that data so we can understand when it was collected, who collected it, how it was recorded, who owns it?
  • How do we ensure the data has not been tampered with?

The answers to these (and many other) questions offer the starting point for a deeper understanding of data and its context. It is only by considering such fundamental concerns that set of data can be considered relevant and usable. Yet, in too many situations these basic issues are not exposed.

Welcome to the real world of data science. By prioritizing “why” in the digital age, we move beyond a data-centric approach to unlock the true potential of technology: creating a more sustainable, efficient, and human-centred future.

 

The path to AI leadership

Unlocking the power of “why” requires a shift in perspective. It’s not just about collecting data, but about understanding its context and purpose. This demands collaboration between data scientists, engineers, domain experts, and most importantly, leaders who embrace a data-driven culture.

Here are some key steps for leaders to take:

  • Invest in data literacy: Equip your workforce with the skills to understand and analyze data.
  • Break down silos: Foster collaboration between different teams to unlock the full potential of legacy data stores and new forms of sensor-generated data.
  • Ask the right questions: Move beyond “what” to “why” and use data to answer meaningful business questions.
  • Embrace ethical considerations: Ensure responsible data collection and use, with a clear understanding of data privacy and security.

The digital revolution is not just about technology; it’s about understanding the human stories woven into the data. By asking “why” and leveraging the power of sensor-rich artefacts, we can unlock a future where technology serves us, not the other way around.

Above all, remember that the true value of data lies not in its isolation, but in its ability to illuminate the intricate tapestry of a situation. By appreciating the power of context, we can unlock the true potential of data-driven decision-making and move beyond the mere recitation of numbers to crafting insightful and impactful choices.

 

Doing more with less

The current AI-driven phase of the digital revolution isn’t just about technology. It’s about weaving human experiences into the data and asking better questions. This starts with asking “why”. By understanding the context behind the numbers, leaders can make smarter, more impactful choices that create a better future for everyone.

AI is more successful when we recognize that data science is as much about storytelling as it is about statistics. Leaders who appreciate this can move beyond the fixation on “getting the data” and learn to ask better questions of the data to ensure AI is used responsibly to shape a more informed, equitable, and sustainable world.

Of course, going back where we started with the “The Hitchhiker’s Guide to the Galaxy” series of books, Douglas Adams left us with a significant sting in the tail. When they finally managed to discover “the ultimate question” after conducting an experiment over millions of years, it turned out to be wrong. Why? I’ll leave you to (re-)read the book and figure that one out for yourselves!


Originally posted here

Read More AI & Data

The post The Secret to AI, the Universe, and Everything: Learn to ask better questions appeared first on Digital Leaders.

]]>