top of page

The Hidden Cybersecurity Risk Most Cyber Leaders Never Measure: Telemetry Quality

ONESECURE
Oct 6
5 min read

There is no shortage of conversations about AI anywhere, everywhere.



AI-powered SOCs. AI analysts. AI-assisted investigations. AI-generated threat intelligence. AI-enhanced response.


The cybersecurity industry is understandably fascinated by what artificial intelligence can do for security operations.


Yet there is a more fundamental question that security leaders should be asking before discussing AI.


Can we trust the evidence our security decisions are built upon?


Because every cybersecurity outcome, regardless of technology stack, starts with one thing: Evidence. And evidence originates from telemetry.


The uncomfortable reality is that many organisations have become highly sophisticated at analysing security data without fully understanding the quality of the data itself.


As cyber leaders continue investing in detection engineering, automation and AI-assisted operations, telemetry quality may become one of the most overlooked strategic risks in enterprise security.


The Cybersecurity Industry Has A Visibility Problem


For years, security leaders have been told that visibility is the answer. More visibility. More logs. More integrations. More telemetry sources. More dashboards. More data.


The assumption is straightforward: If we can see more, we can defend more.


But modern enterprises rarely suffer from a lack of data. Instead, they suffer from uncertainty regarding the quality, completeness and reliability of that data.


The challenge facing many CISOs today is not visibility.


It is confidence.


Confidence that the telemetry arriving in their SIEM is complete.

Confidence that log sources are functioning correctly.

Confidence that identity events are being captured accurately.

Confidence that cloud telemetry reflects reality.

Confidence that investigations are built on reliable evidence.


Without that confidence, visibility becomes little more than an illusion.


The Modern Enterprise Is Increasingly Difficult To Observe


Ten years ago, collecting telemetry was relatively straightforward.


Today, enterprises operate across:

  • Multiple cloud providers

  • Hundreds of SaaS applications

  • Distributed workforces

  • Third-party ecosystems

  • Hybrid infrastructure

  • Multiple identity providers

  • DevOps environments


Each technology layer introduces new telemetry dependencies. Each dependency introduces opportunities for failure.


Security leaders often assume telemetry collection is working because dashboards continue to populate and alerts continue to fire.


However, telemetry degradation is rarely obvious.


Logs may arrive incomplete.

Fields may be parsed incorrectly.

Critical contextual information may be missing.

Time synchronization may drift.

Integrations may silently fail.


The result is a dangerous scenario where security teams continue making decisions with high confidence despite operating from incomplete evidence.


The greatest risk is not the absence of data. The greatest risk is believing the data is complete when it is not.


Why This Matters More Than Most Security Leaders Realise


Every significant cybersecurity decision ultimately depends on evidence.


Consider the questions organisations ask during an incident:

  • Was the attacker successful?

  • Which systems were affected?

  • What data was accessed?

  • Has the threat been contained?

  • Is the organisation safe to resume operations?


None of these questions are answered through technology alone.


They are answered through evidence. And evidence depends on telemetry. If telemetry quality deteriorates, every subsequent layer of security operations becomes less reliable.


Detection engineering suffers. Threat hunting becomes less effective. Incident investigations become slower. Executive reporting becomes less accurate. Board-level decisions become riskier.


This is not simply a technical challenge. It is a business decision-making challenge.


The False Sense Of Security Created By Modern Security Platforms


One reason telemetry quality receives so little attention is because modern security tools are extremely effective at creating confidence.


Dashboards look impressive. Reports look complete. Metrics appear precise.

Coverage appears extensive.


The visual sophistication of security tooling can sometimes obscure a simple reality: A dashboard can only represent the information it receives. If telemetry is incomplete, the dashboard remains incomplete. It simply presents that incompleteness more elegantly.


This creates a dangerous leadership challenge.


Executives often become increasingly confident as security tooling becomes more sophisticated.


Yet the underlying evidence quality may not have improved at all.


In some environments, confidence grows faster than certainty. That should concern every cyber leader.


The Emerging Risk Cyber Leaders Should Be Paying Attention To


As attack surfaces expand, attackers increasingly benefit from telemetry blind spots. Not because they are invisible. But because organisations often do not know where visibility has degraded.


The challenge becomes even more pronounced when organisations acquire companies, migrate workloads, adopt new cloud services or introduce new business applications.


Every change introduces potential telemetry gaps. Every gap creates opportunities for adversaries. Importantly, these are not always technology failures.


Many are governance failures. No one owns telemetry quality. No one measures telemetry integrity. No one reports telemetry confidence to leadership.


As a result, telemetry becomes everyone's responsibility and nobody's accountability.


A Different Way To Think About Security Maturity


Security maturity has traditionally been measured using:

  • Detection coverage

  • Response metrics

  • Technology deployment

  • Compliance controls

  • Framework alignment


These remain important. However, cyber leaders may need to add a new question to the discussion:


Can we trust the evidence supporting our decisions?


This shifts the conversation dramatically.


Instead of asking: "How many detections do we have?"

Ask: "How many of those detections depend on telemetry we have independently validated?"


Instead of asking: "How much visibility do we have?"

Ask: "How much visibility are we assuming we have?"


The answers are often very different.


The Board-Level Conversation That Rarely Happens


Most boards today understand cyber risk.


Many understand ransomware. Many understand third-party risk. Many understand regulatory obligations.


Very few discuss telemetry quality.


Yet telemetry quality directly influences every cybersecurity conclusion presented to the board. If evidence quality cannot be trusted, neither can risk assessments, investigation outcomes or assurance reporting.


This does not mean organisations need perfect telemetry.


Perfect telemetry does not exist. But leaders should understand where confidence is high, where confidence is moderate and where confidence is low.


That level of transparency creates better decisions. And ultimately, more resilient organisations.


The Hard Question


Cyber leaders will hear many discussions about improving detection, automation and response. Those conversations are important.


But perhaps the most valuable conversation is the one that happens before all of them.


A simple question: If your most critical business application stopped generating reliable security telemetry today, how long would it take before anyone noticed?


The answer may reveal more about your security posture than any dashboard ever could.





What is telemetry quality in cybersecurity?

Telemetry quality refers to the completeness, accuracy, consistency and reliability of security data collected from systems, identities, networks, endpoints and cloud environments.

Telemetry provides the evidence used for detection, investigation, threat hunting and incident response. Poor telemetry quality can lead to inaccurate security decisions.

Organisations should validate collection coverage, monitor data source health, verify parsing accuracy, review contextual enrichment and continuously assess telemetry integrity.

Many telemetry failures remain hidden until investigators attempt to reconstruct events during an incident. At that point, missing or inaccurate evidence becomes visible.

CISOs should ask how telemetry quality is measured, validated and monitored, and how the MSSP identifies blind spots before they affect detection and response outcomes.


bottom of page