Benchmarking autonomy — KPIs that drive ROI

Sessions in rooms

Even though Autonomous Networks are increasingly moving from pilots to production, operators still face uncertainty about where to invest, which capabilities deliver measurable ROI, and how to scale adoption efficiently. This session, we’re pleased to launch the TM Forum AN Benchmarks Project. Join us to explore the results of our initial pilot program and explore how operators can use KPIs, domain-level insights, and regional comparisons to model value and prioritise actions. 

Chair: Shuvo Saha, VP of Education, TM Forum 

15:45 – 15:50 
Our challenge: Powering decisions with evidenced value and benchmarking 

• CEO/CFO tension and the competitive one: proving ROI and knowing whether you’re ahead/behind peers 
• What the Autonomous Network Benchmark is, what we’ve learned so far, and how to engage today  
• Identifying the problem that the Benchmark solves: difficulties in comparing fragmented industry progress and linking autonomy measurement needs to business value 
• Advantages of a neutral, anonymised way to compare performance and track progress over time 

Shuvo Saha, VP of Education, TM Forum 

15:50 – 16:05 
Case study: Starting right: How KPN used AOMM and ANLET together to build an evidence-based autonomous operations roadmap 
KPN set an ambitious target: become Europe's most efficient telco by 2030. But before investing in AIOps, digital twins, or intent engines, KPN needed an honest baseline. In this session, KPN and Makman share the industry's first combined AOMM + ANLET assessment -- applying the outside-in/inside-out methodology from IG1403 with independent consultant validation. We'll share what the dual-lens approach revealed that neither framework alone could show, the "aha moments" that reshaped KPN's roadmap priorities, and how the assessment became the foundation for a phased transformation program now underway. 

• Why KPN chose to baseline before investing  
• The dual-lens methodology: AOMM + ANLET combined 
• What the assessment revealed and how it shaped the roadmap  
• Measuring progress: the case for re-assessment cycles  

Luqman Shantal, CEO, Makman Consulting  
Menno Groen, Strategist, Autonomous Operations, KPN  

16:05 – 16:15
AN Impact Benchmark: methodology, tool & early insights

• How the benchmark links network capabilities to outcomes (KCIs → KEIs → KBIs) 
• What is in scope for the MVP pilot?
• Types of early signals emerging so far (value correlation, variance across operators, and where “levels” do/don’t predict impact 

John Gomes, Partner, Bain

16:15 – 16:45
Panel: Early adopters’ viewpoint: the opportunities and challenges ahead

• Each panelist has 60–90 seconds each to explain:  
• The KPI/ROI question they most need answered  
• Why peer comparison matters internally 
• What would make benchmarking “worth it”? 
• The panel will close with one cross‑cutting question from the host: “What would you tell another operator considering joining?” 

Featuring:
Nilmar Seccomandi David, Director of Autonomous Network & Infrastructure, Telefonica 
Afnan Ahmad, Director, Network Strategy and Architecture, Telenor Group  

16:45 – 17:15
Table discussions + participation conversations 
The session will conclude with facilitated table conversations to pressure‑test the benchmark approach, compare the KPI questions people are being asked internally, and identify who wants to explore joining. Panelists join tables, and TM Forum and Bain speakers will circulate to answer governance/anonymity/effort questions and capture follow‑ups with interested companies. 

17:15
Closing remarks
 
All timings are provisional and may be subject to change.