Compare commits

Home / Compare 6c489420 .. 000d9979

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.046-54.054=-0.007
σ0.367-0.371=-0.003
min53.906-53.909=-0.003
max55.091-55.108=-0.017
mean416.900-417.000=-0.100
σ0.316-0.000=0.316
min416.000-417.000=-1.000
max417.000
mean0.139-0.139=-0.000
σ0.003-0.004=-0.000
min0.136-0.133=0.003
max0.145-0.145=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.384-43.393=-0.009
σ0.007-0.007=0.001
min43.374-43.383=-0.010
max43.395-43.408=-0.013
mean417.000
σ0.000
min417.000
max417.000
mean0.120-0.122=-0.002
σ0.006-0.003=0.002
min0.113-0.119=-0.006
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.982-1007.006=-0.025
σ0.868-1.187=-0.319
min1006.480-1006.435=0.046
max1010.572-1011.976=-1.404
mean1045.750-1053.450=-7.700
σ314.043-307.982=6.061
min576.000-578.000=-2.000
max1640.000-1646.000=-6.000
mean1.537-1.564=-0.027
σ0.105-0.102=0.003
min1.379-1.389=-0.010
max1.810-1.850=-0.039

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.421-0.414=0.006
σ0.142-0.151=-0.009
min0.336-0.327=0.009
max0.674-0.683=-0.009
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.912-0.888=0.024
σ0.076-0.102=-0.026
min0.840-0.825=0.015
max1.023-1.067=-0.044
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.535-0.529=0.006
σ0.051-0.057=-0.006
min0.500-0.491=0.009
max0.624-0.630=-0.005
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.841-0.846=-0.005
σ0.038-0.045=-0.006
min0.819-0.812=0.008
max0.909-0.921=-0.012

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.840=-0.009
σ0.026-0.034=-0.008
min964.802-964.813=-0.011
max964.864-964.897=-0.033
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.792-0.826=-0.034
σ0.046-0.038=0.008
min0.718-0.769=-0.051
max0.844-0.870=-0.026
name=cdr_enhanced_4k_loc.art
mean885.513-885.512=0.001
σ0.005-0.007=-0.003
min885.505-885.504=0.001
max885.517-885.522=-0.005
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.713-0.728=-0.015
σ0.025-0.017=0.008
min0.679-0.699=-0.019
max0.739-0.739=-0.000

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.722=-0.001
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean4.229-3.386=0.843
σ0.081-0.292=-0.211
min4.059-2.756=1.303
max4.531-3.782=0.749
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean4.215-3.570=0.645
σ0.072-0.108=-0.036
min4.080-3.347=0.733
max4.403-3.958=0.445
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.737-0.537=0.201
σ0.020-0.025=-0.005
min0.704-0.508=0.197
max0.881-0.685=0.196
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.699-0.506=0.194
σ0.020-0.010=0.010
min0.593-0.486=0.107
max0.782-0.544=0.238

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.579-296.806=-1.227
σ0.203-0.215=-0.012
min295.385-296.664=-1.280
max296.068-297.402=-1.333
mean1911.000-1942.000=-31.000
σ0.000
min1911.000-1942.000=-31.000
max1911.000-1942.000=-31.000
mean0.608-0.591=0.017
σ0.027-0.036=-0.010
min0.584-0.532=0.052
max0.679-0.661=0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.406-286.819=-1.413
σ0.038-0.039=-0.001
min285.354-286.769=-1.415
max285.442-286.859=-1.417
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.389-0.396=-0.007
σ0.009-0.008=0.001
min0.380-0.387=-0.007
max0.401-0.402=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1295.793-1297.247=-1.453
σ0.105-0.062=0.043
min1295.675-1297.163=-1.488
max1295.918-1297.303=-1.385
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean1.932-2.076=-0.144
σ0.107-0.069=0.037
min1.822-2.013=-0.191
max2.053-2.152=-0.099
iters=5
new-facts=6402
prior-facts=1
mean1539.919-1541.309=-1.390
σ6.877-6.837=0.041
min1536.683-1538.065=-1.382
max1552.218-1553.535=-1.317
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean2.227-2.191=0.036
σ0.236-0.105=0.131
min2.048-2.090=-0.042
max2.513-2.357=0.156
iters=5
new-facts=6402
prior-facts=6402
mean1857.707-1859.112=-1.405
σ0.052-0.084=-0.032
min1857.656-1858.988=-1.332
max1857.779-1859.202=-1.423
mean1782.400-1788.000=-5.600
σ132.045-148.607=-16.562
min1640.000-1646.000=-6.000
max1911.000-1942.000=-31.000
mean3.087-2.979=0.108
σ0.276-0.086=0.190
min2.864-2.850=0.015
max3.558-3.067=0.491

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.399-1.227=0.172
σ0.296-0.388=-0.092
min1.110-0.930=0.181
max1.816-1.838=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-448.821=-3.080
σ580.934-581.372=-0.438
min155.272-158.131=-2.859
max1317.142-1320.880=-3.737
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean0.529-0.538=-0.009
σ0.543-0.545=-0.002
min0.255-0.262=-0.007
max1.343-1.356=-0.013
policies=20
mean1552.963-1581.634=-28.670
σ0.321-0.367=-0.046
min1552.750-1581.389=-28.639
max1553.442-1582.181=-28.739
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean2.585-2.649=-0.065
σ0.011-0.008=0.004
min2.572-2.642=-0.070
max2.598-2.658=-0.060
policies=200
mean15537.969-15824.165=-286.196
σ0.162-0.109=0.053
min15537.798-15824.018=-286.220
max15538.143-15824.263=-286.121
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1646.000=-6.000
σ0.000
min1640.000-1646.000=-6.000
max1640.000-1646.000=-6.000
mean26.174-26.679=-0.504
σ0.170-0.075=0.095
min26.057-26.586=-0.529
max26.426-26.767=-0.341