q1a: S&P Net Debt / EBITDA (x)

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 20224.844.140.464.244535.7424.2757976.6774.2347819.6184.06571566.2664.247611.0144.23578.0172.9181.2354.4105321.9074.2162859.1044.81118588.0434.26712.58
ENI S.P.A. 20220.950.860.440.45244735.5580.829572186.0590.73995265.9790.82352942.7040.6847617.7430.823635.3632.1181.3820.5201443.1770.886114.9421.015306120.8360.638403.254
A2A ENERGIA S.P.A. 20223.473.220.942.8629424.3232.8682115.2992.86231814.8453.03361258.8322.8637512.0582.861773.4776.0181.0152.86109425.3532.864213.4853.500332225913621418112145.782.863921.679
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 20224.354.210.724.0643813.5934.186236106.4564.068282109.5034.33268445.8444.1656516.2554.183425.3742.8181.5984.3107721.3865.924823.5594.45611448.1543.866302.484
REDEIA CORPORACION SA 20223.213.560.563.6349512.2694.28590451.8274.28491625.7693.1419345.5943.7951910.6243.793506.9472.4182.2113.2203136.0653.814633.6653.11225693.4983.79245382.205
EDP, S.A. 2022-8.223.740.715.319195375.1173.35627876.5013.3512591100.0424.12636389.3562.8367318.7693.643275.263~2.1x201.7543.4149633.43.657496.5664.4216705130.0283.345562.493
ENGIE 20223.252.700.572.0427012.4572.68924183.5282.6422247112.9522.35448863.8952.3566424.2162.642694.4632.6181.6112.6134527.3274.34683.6552.712304111.0032.865562.051
IBERDROLA SA 20223.914.041.063.40839013.8384.448029173.2264.531099669.9083.88566073.1574.8996341.1314.892465.0481.4181.3983.4158233.8174.895664.3953.821484155.2054.894822.3
NATURGY ENERGY GROUP SA 20222.672.570.372.4827232.1142.48353137.6842.49246417.0422.48173219.3422.1837811.8162.482415.0942.6181.6032.563114.6263.644663.9672.491181597.8972.4867472.958
TenneT Holding B.V. 202283.8537.0825.5056.951537.55154.07877092.39354.11648983.9022.017139120.17754.0455815.09254.12504.827-2.24181.089.58104162.73611.84613.5756.6813120108.40456.936582.563
VEOLIA ENVIRONNEMENT 20223.923.610.343.1842420.1213.613393151.2363.58843748.973.96708985.9083.979225.9253.633865.5544.1181.3363.8120830.0793.065264.8383.6321824166.083.226972.679
ØRSTED A/S 20222.51.610.331.7330110.3471.7387716.6310.94522121.0442.04335838.1341.4775419.1631.732404.5471.14181.3612.0108022.5251.474824.451.741210795.4871.72725512.427
ELECTRICITE DE FRANCE 20224.06-17.3617.94-26.4630121.531-26.468927152.658-24.75823051.158-30.75449464.02626.4783722.465-26.472995.456.4181.027-12.1102724.213-28.174774.865-22.214364112.402-26.465172.143
ERG S.P.A. 2022not available4.070.823.9743411.0643.827422100.8933.53460724.4353.82296336.7683.6571825.563.82734.9696.2181.0733.894520.654.425284.263.1112114101.464.636792.686
Acciona SA 2022not available2.690.212.6845513.2212.66672393.782.661203069.0272.66688075.4382.1877816.5922.662804.9362.9181.0322.6493720.8552.966144.3552.9323395189.4592.666312.464
Fortum Oyj 20221.842.612.411.7436420.6361.5914877201.6581.59561240.0191.59250439.4961.58766117.3031.592144.2029.3181.0351.675318.63.535414.9260.67746766.6673.956182.592
VERBUND AG 20221.61.170.321.21357419.6771.12140013.561.12300418.0661.12167928.8560.9437111.0371.122914.8952.1181.6351.1250810.2170.944453.1981.12642851.3480.9424701.909
ITALGAS S.P.A. 20225.585.240.485.4455717.3915.44683283.7345.43810643.4095.44264251.5655.4454615.695.423686.0633.9181.885.490317.2154.854253.5325.5666150.6685.377482.608
ACEA S.P.A. 2022not available3.790.363.6624815.6194.129579132.0713.66250712.9493.99609292.1023.89278916.6973.733766.2022.9181.1344.12118422.8533.795784.6564.21781228698.6963.585492.349
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 20224.374.320.714.0473815.2164.03443783.1813.96840946.9714.03135819.6644.0344910.7544.033004.1716.2181.7984.04719.0375.145193.754.03802865.4734.02665852.18
HERA S.P.A. 20224.233.770.593.6656134.6484.4210520140.6523.66550928.9514.42469472.6913.7365218.4353.733505.7672.3181.3094.4277416.0763.735584.1043.717930140.5913.72556532.59
VINCI 20221.891.840.091.8667814.1931.938409107.9561.84656438.4141.93583985.9061.9350417.6081.863885.9221.8181.1821.8664314.3071.724623.7621.86808759.7591.6497182.641
BOUYGUES 20223.261.751.001.7440215.2571.612444147.5371.6383123.4912.43571988.8011.5876622.6251.611683.6713.8181.0732.2120026.1140.214383.9292.2514165109.0210.215782.363
FERROVIAL SA 2022not available6.922.796.6779229.7549.218373106.3637.5975855.2049.21486380.1872.964421.9159.34026.6812.6181.2667.6204243.0642.94624.1489.21907970.4369.03465202.359
FailuresMean Absolute Error (ratio)Mean Bias Error (ratio)Root Mean Squared Error (ratio)Time (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.630-0.4521.736551.2422.9714.180.740.030.01
Kimi K2.600.600-0.4061.7222531.56105.4854.921.110.050.02
MiniMax M2.700.607-0.4181.6361141.6747.5730.370.340.010.01
Qwen 3.6 Plus00.646-0.4881.9631484.7161.8625.640.590.020.01
GLM 5.100.5240.2081.292440.4918.356.750.640.030.01
GPT-5.500.603-0.4151.724126.905.291.032.220.090.03
GPT-5 nano10.6190.1721.06433.031.380.320.020.000.00
Claude Opus 4.600.430-0.2840.980715.6029.8229.723.120.130.05
Claude Haiku 4.500.776-0.3741.851155.686.4911.230.520.020.01
Gemini 3.1 Pro Preview00.529-0.3671.5012476.39103.1837.984.800.200.06
Gemini 3.1 Flash-Lite Preview00.698-0.4001.75258.562.440.330.150.010.00

q1b: S&P FFO / Net Debt (x)

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 20220.15670.150.050.183192279.0450.2579722116.3810.1215938100.3710.15534975.17913.23%67318.9239.1%3536.3090.2182.3760.15117228.1530.135144.7440.174884972.1550.074837163.081
ENI S.P.A. 20220.65931.060.361.50279458.7211.426755306.3781.21008372.3231.03686887.3731.22178022.27185.5%5017.9910.28181.8581.2118225.181.345485.3270.6313430109.5650.96535522.725
A2A ENERGIA S.P.A. 20220.23170.290.180.24638818.6670.2718841225.7780.8125216163.4780.23695288.20.3163126.15710.1%5358.580.121181.1470.28105420.7320.35304.2270.2723124206.0840.28556852.915
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 20220.17240.190.020.191560622.1810.18714872319.5140.1922843101.4690.22420550.20.17889630.04118.6%4025.5570.23182.5150.194110523.3820.1495595.1510.171209789.2290.185957782.725
REDEIA CORPORACION SA 20220.20631.594.580.1738091168.1050.17322208254.760.24628578182.680.19562171.3690.2370115.61115.43466.6170.24181.7180.22114524.1230.2655024.3040.17424091185.0130.15374962.251
EDP, S.A. 2022-0.15790.190.060.185782624.4630.13430580356.5650.2519344150.7230.12677094.5190.3143633.07719.4%4047.4130.15181.9630.14117126.8250.286425.9170.12413851115.0190.209186282.815
ENGIE 20220.24830.330.130.435648121.9560.4620740269.4340.3761636189.7140.48697885.0180.1181620.46443.6%3235.110.11181.1210.32106924.3390.314654.8460.2620353178.1570.37516262.59
IBERDROLA SA 20220.19650.190.040.16666737.7890.1917572236.5810.1911493883.760.18518765.3090.1285130.35822.4%5508.2610.235182.0220.253104223.6430.185595.120.204986767.5130.178996272.681
NATURGY ENERGY GROUP SA 20220.28473.6210.970.2985143843.440.3122415255.0930.3451209462.3250.27554775.70.39873019.16436.73746.2070.182181.3150.3785020.0870.247456.9930.36651053185.7520.36655772.126
TenneT Holding B.V. 2022-0.01050.140.16-0.01367229.5620.17926526284.1160.119959137.7840.024726891.079-0.0039133253.77517.7%4827.4960.2181.1970.07114026.9390.548717.5780.07628760225.1170.22698153.265
VEOLIA ENVIRONNEMENT 20220.19720.210.040.23131027.9360.24513835184.1390.23924175432.2120.23479059.88221.16%82133.34717.2%5358.2130.14181.4450.163118926.6480.186455.7080.2121541162.6030.27926123.023
ØRSTED A/S 20220.31243.8811.750.59369734.4530.5221554444.2450.511739887.33943.4%843391.499-8.4%70826.733.0%4938.1530.2181.8520.24119726.1460.295014.79339.325603194.7030.36357092.849
ELECTRICITE DE FRANCE 20220.18840.040.150.0066478527.7190.4821365235.8390.00481710386.9050.0048579463.625-0.073332.0123.45%3976.9470.08181.7070.011108527.122-0.0286926.032-0.046724694194.691-0.05617363.084
ERG S.P.A. 2022not available0.220.060.15397319.2330.2517683238.2920.21319667296.7270.14949796.31518.56%76622.5050.345097.8530.23181.8850.297420.4650.2885945.3450.20425891184.7270.23228362.93
Acciona SA 2022not available0.350.230.342881624.9920.30217368203.3010.372957845.780.31612966.7221.0358820.19930.9%3506.1190.14182.2460.2796520.1850.1910258.8590.28813364106.250.2996252.707
Fortum Oyj 20220.45560.400.180.53590330.7430.5518016224.6310.551263767.0150.29829087.450.344107843.4160.1%2865.4570.2181.1330.44106024.3890.126295.6950.6809667.2340.20796402.505
VERBUND AG 20220.517414.0529.780.78665521.9380.7115351191.8360.8451223563.2090.85578972.42777.44116145.00170.983366.1480.24181.8030.78100322.7690.576195.6810.7819532166.760.56985652.417
ITALGAS S.P.A. 20220.14561.464.330.1746103127.7620.15314888262.9460.17731683687.8660.15573370.6070.1877433.26314.53336.8820.11181.240.14697721.2840.176245.3940.145213791101.8640.14526232.449
ACEA S.P.A. 2022not available0.220.030.218578024.5310.22219947207.8940.22221173494.1590.21362440.1740.20254556212.08521.8%3957.2020.28181.4790.16117522.9780.2254865.1520.21627471217.0170.20255892.406
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 20220.16860.210.080.18370513.970.18216758204.7280.3720421100.3230.18539478.0670.1897729.32112.6%3986.8610.18181.5090.145110524.860.316105.6990.1918603152.6660.311566182.717
HERA S.P.A. 20220.17330.260.110.219247920.3860.23513449228.8610.27632446.9870.24766189.4970.2563926.17923.2%3725.6270.2180.850.1790320.7670.575424.5670.21111487101.1680.24437454.196
VINCI 20220.42210.430.080.42843813.30.44222592259.6660.5425476125.1750.43665874.4110.4378929.02942.9%5048.9570.24181.1550.47106324.8510.3755694.6870.47923527201.5450.4696642.752
BOUYGUES 20220.24460.410.080.4099210648.7290.44723366319.9240.3837802188.9490.51818498.6640.4329107732.78248.2%1504.0490.29181.7970.36125529.0670.547197.0450.331069382.6580.31884442.045
FERROVIAL SA 2022not available0.140.050.1104042.4240.09221911275.0160.172515552113.9240.1740586.6580.280031.8620.1984267.150.1181.4020.1392520.5120.195435.1570.08817870142.7890.14094732.204
FailuresMean Absolute Error (ratio)Mean Bias Error (ratio)Root Mean Squared Error (ratio)Time (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.4560.3040.698882.0436.7531.720.800.030.01
Kimi K2.601.3721.3534.0966105.92254.4165.202.260.090.02
MiniMax M2.701.1581.0352.5372981.20124.2285.940.640.030.01
Qwen 3.6 Plus00.5600.4000.9531859.9477.5014.890.730.030.01
GLM 5.107.9587.59633.254687.5428.659.520.670.030.01
GPT-5.5023.07822.86050.188165.166.881.222.300.100.03
GPT-5 nano01.4170.9204.51938.741.610.430.020.000.00
Claude Opus 4.600.7160.5581.800575.4523.982.722.910.120.03
Claude Haiku 4.503.2182.94811.763134.025.581.090.530.020.01
Gemini 3.1 Pro Preview06.9336.78627.9723410.28142.0952.636.170.260.08
Gemini 3.1 Flash-Lite Preview01.5791.3075.10365.462.730.450.150.010.00

q1c: Leverage Trend (Moody's Adjusted)

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 2022Deteriorating0.000.45Stable52114.804Stable12249126.102Stable8721161.763Stable209429.904Deteriorating98438.85Stable4566.431Stable161.377Stable115819.267Improving12769.095Stable433934.253Stable9093.093
ENI S.P.A. 2022Improving0.910.30Improving88327.571Improving233922.518Improving10338216.765Improving156834.005Improving93036.951Improving5377.541Stable161.008Improving93614.542Improving8936.289Improving592839.727Improving7993.168
A2A ENERGIA S.P.A. 2022Stable0.090.30Stable43812.892Stable84017.09Stable773384.769Stable137120.025Stable74918.721Stable2934.727Improving9066.017Stable75713.61Stable8765.995Stable322826.322Stable7102.987
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 2022Improving0.910.30Improving50416.928Improving80632.324Improving329382.47Improving195531.162Improving73317.37Improving4736.924Stable161.362Improving94316.004Improving8635.809Improving402829.774Improving7472.673
REDEIA CORPORACION SA 2022Stable0.550.52Improving60912.946Improving10917151.575Stable3277155.858Stable232925.659Improving86330.498Stable4316.221Stable161.322Improving113419.752Improving9056.118Improving738954.474Stable7853.419
EDP, S.A. 2022Improving0.820.40Improving59122.612Improving178118.916Improving543165.566Stable336342.385Improving78517.609Improving4158.736Stable160.938Improving100718.487Improving8686.453Improving881162.924Improving7073.453
ENGIE 2022Deteriorating0.090.70Stable34617.597Stable13229211.462Improving760883.913Stable359455.306Deteriorating86224.119Deteriorating4887.227Stable161.017Stable85315.822Improving6594.768Improving468037.187Stable5962.114
IBERDROLA SA 2022Deteriorating-0.730.47Deteriorating51916.846Deteriorating132333.03Deteriorating463744.923Deteriorating246534.98Deteriorating60821.776Deteriorating3345.657Stable160.816Stable111418.11Deteriorating6535.06Stable493736.139Deteriorating7012.785
NATURGY ENERGY GROUP SA 2022Improving0.910.30Improving67617.914Improving127713.355Improving595047.073Improving174019.01Improving70424.692Improving3535.548Stable161.367Improving74312.724Improving8226.308Improving308522.762Improving7282.395
TenneT Holding B.V. 2022NA-0.910.30Deteriorating3047.837Deteriorating315396.306Deteriorating7823194.746Deteriorating180922.94Deteriorating52613.475Deteriorating3274.943Stable160.915Deteriorating89116.278Deteriorating7885.508Deteriorating376826.625Deteriorating6912.526
VEOLIA ENVIRONNEMENT 2022Deteriorating-0.910.30Deteriorating51418.427Deteriorating108445.51Deteriorating554960.613Deteriorating321647.165Deteriorating83816.803Deteriorating6368.337Stable160.948Deteriorating114919.91Deteriorating8766.827Deteriorating533738.052Deteriorating11216.087
ØRSTED A/S 2022Improving0.640.50Stable51713.685Improving435443.87Improving6658100.524Improving226845.172Improving68220.366Improving4426.498Stable161.015Stable107021.869Improving8796.266Improving572441.672Stable5962.524
ELECTRICITE DE FRANCE 2022Improving-0.910.30Deteriorating46216.895Deteriorating262137.603Deteriorating6432181.751Deteriorating153831.501Deteriorating58217.191Deteriorating3616.328Stable160.928Deteriorating70813.489Deteriorating8446.565Deteriorating280224.494Deteriorating5982.52
ERG S.P.A. 2022Improving0.910.30Improving82430.26Improving178055.744Improving361651.221Improving140917.355Improving83818.793Improving6809.364Stable160.901Improving112119.941Improving9896.967Improving399427.151Improving9633.262
Acciona SA 2022Improving0.550.52Improving61915.733Improving9739117.753Improving7945104.693Improving262450.391Improving81224.987Stable4436.101Stable160.89Stable125322.365Stable8355.783Improving656048.951Stable8923.66
Fortum Oyj 2022Improving0.450.82Improving38426.546Improving10563197.906Stable535750.056Improving147715.428Deteriorating63219.992Stable3245.606Deteriorating6214.815Improving87616.43Improving7124.943Improving335027.812Improving7312.9
VERBUND AG 2022Improving0.820.40Improving37011.979Improving103912.639Stable595344.37Improving182531.016Improving103437.561Improving3595.052Stable160.979Improving5709.388Improving7375.733Improving278521.974Improving7112.423
ITALGAS S.P.A. 2022Deteriorating-0.910.30Deteriorating63712.689Deteriorating66114.623Deteriorating282048.821Deteriorating136726.881Deteriorating95020.317Deteriorating4676.882Stable160.94Deteriorating89318.198Deteriorating8806.064Deteriorating350727.135Deteriorating8862.873
ACEA S.P.A. 2022Deteriorating0.180.40Stable42525.143Stable650491.2Stable11979207.234Stable280145.116Improving80622.885Stable3415.566Stable161.786Stable64910.76Improving8996.956Stable652750.619Stable6632.405
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 2022Improving0.910.30Improving51414.687Improving122512.511Improving5700106.426Improving179030.608Improving90926.317Improving4235.937Stable160.855Improving71310.921Improving7044.686Improving349226.825Improving5672.234
HERA S.P.A. 2022Deteriorating-0.910.30Deteriorating83625.315Deteriorating7943108.022Deteriorating5305158.094Deteriorating192737.389Deteriorating57013.861Deteriorating4626.452Stable160.871Deteriorating89516.079Deteriorating8825.588Deteriorating309321.377Deteriorating6732.754
VINCI 2022Improving0.820.40Improving68812.695Improving8580107.676Stable15438116.275Improving183635.964Improving72227.617Improving4897.065Stable161.038Improving78513.242Improving8255.767Improving348526.797Improving6162.845
BOUYGUES 2022Deteriorating-1.000.00Deteriorating37213.096Deteriorating341038.761Deteriorating11267122.359Deteriorating133723.417Deteriorating46121.902Deteriorating3044.826Deteriorating7004.721Deteriorating89617.326Deteriorating7355.942Deteriorating246618.063Deteriorating5622.4
FERROVIAL SA 2022Deteriorating-0.910.30Deteriorating70135.554Deteriorating9413107.181Deteriorating7330220.25Deteriorating381365.345Deteriorating70315.667Deteriorating5408.865Stable160.985Deteriorating98318.668Deteriorating6635.046Deteriorating648147.203Deteriorating7202.952
FailuresMean Absolute ErrorMean Bias ErrorRoot Mean Squared ErrorTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.300.040.63440.6518.366.810.750.030.01
Kimi K2.600.260.090.591713.6871.4059.210.860.040.02
MiniMax M2.700.39-0.040.752710.53112.9459.830.320.010.00
Qwen 3.6 Plus00.260.000.59818.1234.0912.620.430.020.00
GLM 5.100.30-0.040.75548.3222.857.150.660.030.01
GPT-5.500.26-0.090.59156.836.531.302.330.100.03
GPT-5 nano00.96-0.171.0237.811.581.430.020.000.00
Claude Opus 4.600.390.040.69393.1816.383.502.830.120.03
Claude Haiku 4.500.430.170.88144.546.020.920.560.020.01
Gemini 3.1 Pro Preview00.350.170.72818.3134.1011.782.370.100.03
Gemini 3.1 Flash-Lite Preview00.30-0.040.6370.452.940.780.160.010.00

q2: Suitability

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 2022Strongly Suitable1.500.53Marginally Suitable63421.868Marginally Suitable84313.985Marginally Suitable280524.465Strongly Suitable71911.903Strongly Suitable59620.05Marginally Suitable46210.271FAIL120.948Strongly Suitable74320.313Marginally Suitable8509.317Strongly Suitable102211.73Strongly Suitable4302.466
ENI S.P.A. 2022Marginally Suitable1.910.30Strongly Suitable65520.474Marginally Suitable100029.506Strongly Suitable177323.328Strongly Suitable76513.342Strongly Suitable46620.195Strongly Suitable36610.949Strongly Suitable4654.449Strongly Suitable80120.211Strongly Suitable9259.445Strongly Suitable143312.363Strongly Suitable3962.741
A2A ENERGIA S.P.A. 2022Marginally Suitable1.550.52Strongly Suitable52316.623Marginally Suitable86622.154Marginally Suitable276484.199Strongly Suitable122915.531Strongly Suitable62923.399Marginally Suitable46810.828Marginally Suitable4454.126Strongly Suitable82521.63Marginally Suitable8178.7Strongly Suitable101410.947Strongly Suitable3932.427
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 2022Marginally Suitable2.000.00Strongly Suitable49412.491Strongly Suitable6176.439Strongly Suitable545884.864Strongly Suitable75821.888Strongly Suitable42513.592Strongly Suitable44710.546Strongly Suitable1331.731Strongly Suitable70117.635Strongly Suitable8989.669Strongly Suitable125510.809Strongly Suitable2861.856
REDEIA CORPORACION SA 2022Strongly Suitable1.820.40Strongly Suitable43713.47Strongly Suitable91813.398Strongly Suitable110235.052Strongly Suitable84814.417Strongly Suitable44514.4Marginally Suitable49712.94Strongly Suitable4174.173Strongly Suitable80423.056Marginally Suitable7528.873Strongly Suitable162013.797Strongly Suitable3432.18
EDP, S.A. 2022Strongly Suitable1.730.47Marginally Suitable41720.235Marginally Suitable78011.966Strongly Suitable254368.329Strongly Suitable86729.495Strongly Suitable46921.154Strongly Suitable50512.25Marginally Suitable3914.371Strongly Suitable87721.931Strongly Suitable7188.503Strongly Suitable139513.306Strongly Suitable3902.298
ENGIE 2022Strongly Suitable1.270.79Marginally Suitable57017.405Marginally Suitable8559.788Not Suitable328646.721Strongly Suitable74822.35Strongly Suitable42912.1Marginally Suitable45411.455Not Suitable4843.687Strongly Suitable83420.024Marginally Suitable9759.942Strongly Suitable128913.191Strongly Suitable3812.037
IBERDROLA SA 2022Strongly Suitable1.820.40Strongly Suitable2567.624Strongly Suitable88513.837Marginally Suitable254142.95Strongly Suitable72416.247Strongly Suitable57619.778Strongly Suitable3958.893Marginally Suitable3693.69Strongly Suitable94221.505Strongly Suitable8758.695Strongly Suitable137514.914Strongly Suitable4612.475
NATURGY ENERGY GROUP SA 2022Marginally Suitable1.820.40Strongly Suitable45918.199Strongly Suitable87916.065Strongly Suitable448355.641Strongly Suitable99812.603Strongly Suitable50715.517Marginally Suitable43310.567Marginally Suitable4903.686Strongly Suitable95021.536Strongly Suitable111911.611Strongly Suitable144312.896Strongly Suitable3822.168
TenneT Holding B.V. 2022Strongly Suitable1.450.52Marginally Suitable2818.016Marginally Suitable75016.22Marginally Suitable5369101.53Strongly Suitable85211.729Strongly Suitable54713.579Marginally Suitable4258.858Marginally Suitable3924.352Strongly Suitable85923.106Marginally Suitable122212.251Strongly Suitable9659.585Strongly Suitable4192.729
VEOLIA ENVIRONNEMENT 2022Strongly Suitable1.550.69Strongly Suitable60730.66Marginally Suitable7839.735Strongly Suitable370237.21Strongly Suitable73527.492Strongly Suitable44017.892Marginally Suitable51912.864Not Suitable171.138Strongly Suitable72119.838Marginally Suitable95810.321Strongly Suitable142619.185Strongly Suitable5233.252
ØRSTED A/S 2022Strongly Suitable2.000.00Strongly Suitable2797.971Strongly Suitable80816.242Strongly Suitable320377.349Strongly Suitable95811.431Strongly Suitable50218.126Strongly Suitable40810.874Strongly Suitable2042.273Strongly Suitable92924.706Strongly Suitable111110.755Strongly Suitable130910.604Strongly Suitable3572.468
ELECTRICITE DE FRANCE 2022Strongly Suitable0.640.67Not Suitable77323.405Marginally Suitable112220.901Not Suitable7376136.929Marginally Suitable106013.569Strongly Suitable55016.51Marginally Suitable39110.182Marginally Suitable1891.987Marginally Suitable85122.13Not Suitable96510.484Not Suitable127011.518Not Suitable4202.478
ERG S.P.A. 2022Not Suitable1.640.50Strongly Suitable47613.93Marginally Suitable87916.184Strongly Suitable425582.999Strongly Suitable108618.158Strongly Suitable48010.817Marginally Suitable45512.745Marginally Suitable4703.997Strongly Suitable109027.536Marginally Suitable92410.207Strongly Suitable243821.143Strongly Suitable3892.242
Acciona SA 2022Not Suitable1.550.52Marginally Suitable46417.753Marginally Suitable73813.541Marginally Suitable313762.633Strongly Suitable94511.908Strongly Suitable36013.05Marginally Suitable4309.94Marginally Suitable5174.041Strongly Suitable101527.088Strongly Suitable7608.284Strongly Suitable158713.818Strongly Suitable3932.692
Fortum Oyj 2022Not Suitable0.730.47Not Suitable41318.734Marginally Suitable75213.664Marginally Suitable270257.737Marginally Suitable112014.322Marginally Suitable62724.325Marginally Suitable3749.249Marginally Suitable2182.516Marginally Suitable84421.345Marginally Suitable108610.848Not Suitable158616.623Not Suitable4262.536
VERBUND AG 2022Not Suitable1.910.30Strongly Suitable3128.293Marginally Suitable7249.516Strongly Suitable173938.052Strongly Suitable100121.173Strongly Suitable47817.398Strongly Suitable53711.954Strongly Suitable4853.925Strongly Suitable89423.64Strongly Suitable8488.931Strongly Suitable166617.48Strongly Suitable3732.412
ITALGAS S.P.A. 2022Not Suitable1.640.50Strongly Suitable62738.901Strongly Suitable71815.41Marginally Suitable327172.336Strongly Suitable104617.224Strongly Suitable45914.927Marginally Suitable3918.444Marginally Suitable3703.541Strongly Suitable97124.234Marginally Suitable114211.384Strongly Suitable167218.513Strongly Suitable4852.589
ACEA S.P.A. 2022Marginally Suitable1.450.52Marginally Suitable53614.39Marginally Suitable89813.476Marginally Suitable338194.048Strongly Suitable198424.986Strongly Suitable49017.901Marginally Suitable39610.493Marginally Suitable5094.532Strongly Suitable83220.57Marginally Suitable9309.521Strongly Suitable147012.798Strongly Suitable4162.168
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 2022Marginally Suitable1.730.47Marginally Suitable63536.308Strongly Suitable7879.151Marginally Suitable266359.241Strongly Suitable72410.774Strongly Suitable39017.038Strongly Suitable41210.443Marginally Suitable7845.857Strongly Suitable89523.633Strongly Suitable98111.007Strongly Suitable114512.072Strongly Suitable3822.262
HERA S.P.A. 2022Marginally Suitable1.270.47Strongly Suitable50115.803Marginally Suitable91710.106Marginally Suitable6231100.311Marginally Suitable101515.562Strongly Suitable52118.51Marginally Suitable44810.343Marginally Suitable4744.501Marginally Suitable83922.351Marginally Suitable100710.638Strongly Suitable152314.108Marginally Suitable4382.324
VINCI 2022Not Suitable1.910.30Strongly Suitable34235.135Strongly Suitable7068.549Strongly Suitable2849133.531Strongly Suitable109216.769Strongly Suitable45313.045Strongly Suitable3598.328Marginally Suitable4664.432Strongly Suitable88723.765Strongly Suitable7517.389Strongly Suitable159116.634Strongly Suitable3552.229
BOUYGUES 2022Not Suitable1.640.50Strongly Suitable49112.035Marginally Suitable8259.143Marginally Suitable369072.566Strongly Suitable77122.894Strongly Suitable53519.149Strongly Suitable3909.426Marginally Suitable4413.497Strongly Suitable95425.744Marginally Suitable7418.032Strongly Suitable156413.477Strongly Suitable4772.578
FERROVIAL SA 2022Not Suitable1.360.67Marginally Suitable30933.415Marginally Suitable76217.226Marginally Suitable304551.909Strongly Suitable92113.683Strongly Suitable56721.922Marginally Suitable4129.528Insufficient Data1692.289Strongly Suitable73519.56Marginally Suitable7538.151Strongly Suitable228818.85Strongly Suitable4242.664
FailuresMean Absolute ErrorMean Bias ErrorRoot Mean Squared ErrorTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.960.461.21463.1419.309.340.740.030.01
Kimi K2.600.790.290.98336.2014.015.090.470.020.01
MiniMax M2.700.880.291.141643.9368.5030.440.220.010.00
Qwen 3.6 Plus00.920.831.22409.4517.065.360.340.010.00
GLM 5.100.920.921.22414.3717.273.620.630.030.01
GPT-5.500.830.331.04252.3710.521.342.320.100.03
GPT-5 nano10.780.091.0283.743.491.220.020.000.00
Claude Opus 4.600.920.831.22537.0922.382.412.790.120.03
Claude Haiku 4.500.920.331.12232.969.711.270.570.020.01
Gemini 3.1 Pro Preview00.960.791.27340.3614.183.091.480.060.01
Gemini 3.1 Flash-Lite Preview00.920.751.2658.272.430.280.150.010.00

q3: Size

ground truthLLM averageLLM std. dev.DeepSeek-V4-ProOut tokensTimeKimi K2.6Out tokensTimeMiniMax M2.7Out tokensTimeQwen 3.6 PlusOut tokensTimeGLM 5.1Out tokensTimeGPT-5.5Out tokensTimeGPT-5 nanoOut tokensTimeClaude Opus 4.6Out tokensTimeClaude Haiku 4.5Out tokensTimeGemini 3.1 Pro PreviewOut tokensTimeGemini 3.1 Flash-Lite PreviewOut tokensTime
ENEL - SPA 202250%0.550.33100%63919.26350%112316.232100%635786.14625%137034.89425%56416.7725%3347.2925%7255.8975%97027.23450%107811.701100%201217.59325%6183.466
ENI S.P.A. 202225%0.640.3450%63529.83450%258828.2525%7106170.717100%99023.45100%69318.29275%55011.435100%8937.41550%91724.8840%9009.71650%978769.779100%6442.731
A2A ENERGIA S.P.A. 202225%0.550.3750%61518.66650%117124.25450%328294.7620%182427.805100%58819.50975%47912.1820%1611.93450%71918.45525%8589.382100%341832.052100%5203.012
"TERNA - RETE ELETTRICA NAZIONALE SOCIETA' PER AZIONI" (IN FORMA ABBREVIATA "TERNA S.P.A.") 202225%0.550.25100%52012.22450%140316.64950%683465.11550%300342.96550%46610.23950%3938.80425%8316.66450%88421.46150%104511.166100%420336.74825%5892.629
REDEIA CORPORACION SA 202250%0.660.3275%59530.83250%151420.298100%229922.52950%149233.511100%85726.46350%59112.8650%5885.47950%86320.93650%89710.246100%234418.963100%5942.595
EDP, S.A. 202250%0.680.3275%59317.70650%153050.28250%336634.582100%137118.93550%58112.43575%42110.9620%6314.934100%99827.00950%121813.197100%204518.658100%4782.798
ENGIE 202250%0.700.2975%46922.09550%127013.16375%440963.825100%108118.863100%65218.95650%44810.882100%3933.72375%94626.08825%120113.038100%341331.43925%6492.699
IBERDROLA SA 202275%0.750.27100%47320.65175%128615.963100%20022187.52650%145918.913100%52014.30750%34410.07325%161.03775%96524.93850%109711.578100%283722.82100%5632.677
NATURGY ENERGY GROUP SA 202225%0.660.3950%47718.605100%96615.98100%254134.688100%164341.726100%53720.40975%42410.2880%5094.33750%91423.32550%102910.537100%464637.310%7132.766
TenneT Holding B.V. 202250%0.570.2075%52718.972100%114311.16550%642847.98950%332439.1850%44112.39850%4089.19850%7095.09475%89930.67425%111512.45250%407028.83150%6392.676
VEOLIA ENVIRONNEMENT 202250%0.570.2550%54215.86250%275635.28750%454725.61350%245431.21450%67816.08975%3409.19925%3613.63125%104224.83250%90310.55100%498538.83100%5422.924
ØRSTED A/S 202250%0.820.16100%48015.157100%385169.518100%6819129.95475%330562.04575%59413.04775%3327.929100%7688.61475%95624.33650%123312.75775%331127.03475%6712.801
ELECTRICITE DE FRANCE 202275%0.770.36100%50126.48350%188639.039100%6105171.561100%120718.626100%77624.61275%37010.49125%5264.668100%84123.4150%106912.178100%280628.354100%5492.7
ERG S.P.A. 20220%0.590.3950%39811.71350%148822.432100%602334.364100%285526.6090%81122.44675%39511.1490%2682.71150%94325.65725%96911.476100%354431.817100%6182.904
Acciona SA 20220%0.660.39100%5079.5150%113512.5720%431799.14100%248241.624100%57416.21175%43612.6570%2073.0650%81320.91150%9799.946100%187817.654100%6582.972
Fortum Oyj 20220%0.430.3650%58513.30150%144929.1970%14947218.634100%152836.9750%77126.4550%3387.960%6865.99950%82622.89625%98811.574100%353833.5550%6192.907
VERBUND AG 20220%0.550.3350%48815.05650%117121.185100%367162.844100%116415.946100%60313.56650%4189.36325%4923.93650%86122.17650%133613.6740%153615.45225%5132.524
ITALGAS S.P.A. 20220%0.800.2550%64318.40475%148926.587100%887158.49100%220032.012100%61815.86850%3789.832100%7276.00850%96324.24850%103811.453100%122112.926100%5522.569
ACEA S.P.A. 202225%0.590.3050%66820.2250%8728.741100%649847.269100%106714.27750%74320.69275%3208.01325%8436.93550%69119.40525%158117.737100%329527.63825%5442.52
REN - REDES ENERGÉTICAS NACIONAIS, SGPS, S.A. 202225%0.700.400%54012.812100%105813.329100%19800151.713100%186717.308100%62315.8775%51912.5950%9597.13850%81122.26850%111912.039100%150815.446100%4932.363
HERA S.P.A. 202225%0.610.3850%59718.41950%185419.927100%428996.521100%178124.85650%54811.90475%38710.8820%6184.89850%76721.0060%103810.637100%357629.195100%5302.396
VINCI 20220%0.590.39100%51820.29950%128213.7850%9470171.524100%105013.8550%64317.96275%43110.380%6888.81450%92823.56225%8519.305100%227823.679100%6512.721
BOUYGUES 20220%0.750.32100%54616.90275%184524.257100%646380.0140%199633.84650%62515.07375%3097.876100%5234.59475%93425.83350%105211.127100%215721.184100%5402.435
FERROVIAL SA 20220%0.610.2650%58419.13100%181216.987100%401479.03850%189032.89550%66625.15550%40610.93125%161.40150%96024.95950%105611.305100%307527.80150%6353.139
FailuresMean Absolute ErrorMean Bias ErrorRoot Mean Squared ErrorTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro00.4270.4060.503442.1218.425.230.770.030.01
Kimi K2.600.3750.3540.473565.0823.5413.770.550.020.01
MiniMax M2.700.4480.4480.5892234.5693.1157.480.320.010.01
Qwen 3.6 Plus00.5310.4690.643702.3329.2611.620.410.020.00
GLM 5.100.4270.4060.538424.7217.704.730.660.030.01
GPT-5.500.3960.3540.462243.2410.131.632.360.100.03
GPT-5 nano00.3230.0310.436118.914.952.080.030.000.00
Claude Opus 4.600.3330.3120.375570.5123.772.732.880.120.03
Claude Haiku 4.500.2500.0830.323278.7711.621.760.600.020.01
Gemini 3.1 Pro Preview00.6250.6250.703664.7527.7011.652.010.080.03
Gemini 3.1 Flash-Lite Preview00.5100.4480.61065.922.750.250.160.010.00

q4: priority

Ground truth prioritiesGround truth orderLLM dist averageLLM dist std. dev.DeepSeek-V4-ProDistanceOut tokensTimeKimi K2.6DistanceOut tokensTimeMiniMax M2.7DistanceOut tokensTimeQwen 3.6 PlusDistanceOut tokensTimeGLM 5.1DistanceOut tokensTimeGPT-5.5DistanceOut tokensTimeGPT-5 nanoDistanceOut tokensTimeClaude Opus 4.6DistanceOut tokensTimeClaude Haiku 4.5DistanceOut tokensTimeGemini 3.1 Pro PreviewDistanceOut tokensTimeGemini 3.1 Flash-Lite PreviewDistanceOut tokensTime
ELECTRIC - "TERNA - - IBERDROL 202211, 8, 3C,B,A0.730.65C,B,A069121.587C,A,B1117422.838C,B,A0697771.368B,C,A1111854.67B,C,A161720.005C,A,B156813.526C,A,B1173.836C,A,B1108930.264C,B,A097511.953A,C,B2314930.46C,B,A03722.563
ENI S.P. - TenneT H - REDEIA C 202212, 7, 4C,B,A2.090.83A,B,C367045.462A,C,B298918.762A,C,B2244889.993A,B,C31169105.613B,C,A156419.804B,C,A178415.411A,B,C3172.374B,C,A1110436.058A,C,B27328.498A,B,C3422740.118A,C,B25203.447
VEOLIA E - ELECTRIC - REDEIA C 2022 5, 11, 4C,A,B1.271.27C,A,B045716.123A,C,B186317.957C,A,B0662299.041C,A,B0125328.912B,A,C358111.212B,A,C349613.779A,B,C2172.185B,A,C3113432.934A,C,B1141414.535A,C,B1513757.352C,A,B04253.106
"TERNA - - A2A ENER - REDEIA C 2022 8, 9, 4C,A,B1.090.70C,A,B077526.161A,C,B189214.103A,C,B1610274.77C,A,B0283751.867A,C,B147319.374B,C,A246112.417A,B,C2182.07B,C,A294426.304A,C,B196711.918A,C,B1749466.231A,C,B14363.191
A2A ENER - ENEL - S - "TERNA - 2022 9, 1, 8B,C,A0.360.50C,B,A153123.337C,B,A1150124.007B,C,A0346347.329B,C,A0100448.729B,C,A060219.038B,C,A052811.101B,A,C1172.227C,B,A1117031.79B,C,A07689.744B,C,A0214023.342B,C,A04032.997
EDP, S.A - ELECTRIC - VEOLIA E 2022 2, 11, 5A,C,B1.360.92C,A,B189825.123C,A,B1119824.16C,A,B1399269.172C,A,B11825258.216C,A,B159913.533B,C,A343113.231C,B,A2172.323C,A,B1114332.567A,C,B094310.533B,C,A3360536.645C,A,B14153.428
EDP, S.A - A2A ENER - TenneT H 2022 2, 9, 7A,C,B0.820.40C,A,B162718.758A,B,C189314.346A,B,C1484462.812C,A,B11094123.56A,C,B063919.406C,A,B157410.97C,A,B1171.792A,C,B0105429.401A,B,C1118213.29C,A,B1265629.07C,A,B14883.101
ØRSTED A - ENEL - S - A2A ENER 2022 6, 1, 9B,A,C0.730.47A,B,C135515.113A,B,C199920.205A,B,C110040106.747A,B,C199059.772B,A,C048813.562B,A,C054511.219B,A,C0172.898A,B,C193223.561A,B,C191511.072A,B,C1321133.735A,B,C14673.38
REDEIA C - ELECTRIC - "TERNA - 2022 4, 11, 8A,C,B1.451.13B,C,A342918.748C,A,B1117221.571C,A,B12306117.46A,C,B01332181.231B,C,A356017.991C,A,B149312.643B,A,C2172.055C,A,B1116832.927A,C,B0105011.437B,C,A3301930.976C,A,B14142.763
ENEL - S - ELECTRIC - VEOLIA E 2022 1, 11, 5A,C,B1.270.90B,A,C2106630.014A,C,B0142822.518A,C,B04653136.139B,A,C2110046.405C,B,A272420.748B,A,C263111.963C,B,A2172.507C,A,B1101928.498A,C,B08369.599B,A,C2299327.689C,A,B14413.393
TenneT H - ENI S.P. - ENEL - S 2022 7, 12, 1C,A,B0.910.83A,C,B167628.69C,B,A199322.559C,A,B07906146.289A,B,C2136192.966C,A,B060722.778C,A,B049712.563B,C,A25167.161A,C,B1107729.202A,C,B17999.915C,A,B0657560.725B,C,A24593.552
TenneT H - REDEIA C - ENGIE 2022 7, 4, 10B,A,C1.550.93A,C,B237722.778A,C,B2116152.416B,C,A14530185.779B,A,C0107646.068A,C,B265616.594A,C,B23978.901A,B,C1171.74A,C,B2105335.391B,A,C0115414.707C,A,B3295527.373A,C,B25322.949
FailuresAverage DistanceTime (total)Time (average)Time (std. dev.)Cost (total)Cost (average)Cost (std. dev.)
DeepSeek-V4-Pro01.25291.8924.328.131.170.100.02
Kimi K2.601.08275.4422.959.890.680.060.01
MiniMax M2.700.671206.90100.5740.250.270.020.00
Qwen 3.6 Plus00.921098.0191.5067.990.490.040.01
GLM 5.101.17214.0417.843.440.970.080.01
GPT-5.501.33147.7212.311.663.460.290.05
GPT-5 nano01.5833.172.761.490.030.000.00
Claude Opus 4.601.25368.9030.743.634.020.340.06
Claude Haiku 4.500.58137.2011.431.960.800.070.01
Gemini 3.1 Pro Preview01.67463.7238.6414.552.270.190.03
Gemini 3.1 Flash-Lite Preview01.0037.873.160.300.220.020.00