Compare commits

Home / Compare e53b45e6 .. 5eff42c3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.054=-0.001
σ0.368-0.370=-0.003
min53.908-53.903=0.004
max55.100-55.108=-0.008
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.138-0.141=-0.004
σ0.010-0.004=0.005
min0.120-0.134=-0.014
max0.148-0.147=0.000
cache=y
dps=1
iters=10
policies=100
mean43.394-43.392=0.003
σ0.007-0.006=0.001
min43.389-43.382=0.007
max43.408-43.404=0.004
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.121-0.120=0.001
σ0.004-0.004=-0.001
min0.115-0.114=0.001
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.003-1007.002=0.001
σ1.198-1.193=0.004
min1006.432-1006.445=-0.013
max1012.028-1012.008=0.019
mean1054.050-1039.550=14.500
σ308.046-298.301=9.745
min579.000-582.000=-3.000
max1646.000-1585.000=61.000
mean1.518-1.530=-0.012
σ0.060-0.124=-0.064
min1.462-1.330=0.132
max1.711-1.837=-0.126

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.423-0.412=0.010
σ0.146-0.121=0.025
min0.346-0.340=0.005
max0.683-0.626=0.056
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.879-0.872=0.007
σ0.092-0.077=0.016
min0.804-0.822=-0.018
max1.034-1.006=0.029
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.540-0.543=-0.003
σ0.045-0.048=-0.004
min0.493-0.503=-0.010
max0.611-0.622=-0.011
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.862-0.846=0.016
σ0.040-0.033=0.007
min0.827-0.816=0.011
max0.931-0.898=0.033

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.838-964.835=0.003
σ0.034-0.029=0.005
min964.809-964.819=-0.010
max964.895-964.886=0.009
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.827-0.818=0.008
σ0.030-0.040=-0.010
min0.795-0.749=0.046
max0.862-0.849=0.013
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.005=0.002
min885.504
max885.521-885.515=0.006
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.718-0.706=0.012
σ0.033-0.015=0.019
min0.676-0.686=-0.011
max0.746-0.727=0.020

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.001
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean4.245-4.270=-0.025
σ0.089-0.078=0.012
min4.103-4.161=-0.058
max4.629-4.730=-0.101
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean4.249-4.309=-0.060
σ0.074-0.103=-0.029
min4.135-4.172=-0.037
max4.549-4.685=-0.136
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.752-0.614=0.138
σ0.016-0.109=-0.092
min0.722-0.515=0.206
max0.853-0.862=-0.009
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.714-0.515=0.199
σ0.018-0.019=-0.001
min0.640-0.492=0.149
max0.792-0.673=0.119

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.939-296.900=0.040
σ0.246-0.263=-0.016
min296.771-296.725=0.047
max297.619-297.626=-0.007
mean2030.000-1900.000=130.000
σ0.000
min2030.000-1900.000=130.000
max2030.000-1900.000=130.000
mean0.545-0.573=-0.028
σ0.037-0.055=-0.018
min0.507-0.507=-0.000
max0.584-0.695=-0.111

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.823-286.820=0.003
σ0.040-0.037=0.003
min286.768-286.769=-0.001
max286.865-286.859=0.006
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.395-0.395=-0.000
σ0.007-0.007=0.000
min0.387-0.387=0.000
max0.401-0.401=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1297.253-1297.212=0.041
σ0.106-0.069=0.037
min1297.095-1297.131=-0.036
max1297.373-1297.296=0.078
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean2.216-2.054=0.163
σ0.109-0.051=0.058
min2.053-2.004=0.049
max2.336-2.129=0.206
iters=5
new-facts=6402
prior-facts=1
mean1541.377-1541.363=0.015
σ6.793-6.809=-0.016
min1538.225-1538.150=0.075
max1553.528-1553.540=-0.012
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean2.332-2.343=-0.011
σ0.260-0.232=0.028
min2.140-2.102=0.039
max2.777-2.700=0.077
iters=5
new-facts=6402
prior-facts=6402
mean1859.118-1859.122=-0.005
σ0.065-0.067=-0.002
min1859.024-1859.038=-0.014
max1859.190-1859.202=-0.012
mean1782.800-1758.600=24.200
σ167.096-141.081=26.016
min1646.000-1585.000=61.000
max2030.000-1900.000=130.000
mean2.898-3.020=-0.122
σ0.100-0.360=-0.260
min2.789-2.714=0.075
max3.035-3.542=-0.507

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.257-1.279=-0.022
σ0.322-0.388=-0.066
min0.946-0.930=0.016
max1.790-1.866=-0.076

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.818=0.001
σ581.372-581.373=-0.001
min158.130-158.129=0.001
max1320.878-1320.878=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean0.553-0.555=-0.002
σ0.578-0.577=0.002
min0.260-0.263=-0.002
max1.420-1.420=0.000
policies=20
mean1581.619-1581.606=0.013
σ0.360-0.352=0.008
min1581.379-1581.370=0.009
max1582.155-1582.130=0.025
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean2.632-2.635=-0.004
σ0.017-0.007=0.010
min2.613-2.630=-0.016
max2.652-2.645=0.007
policies=200
mean15824.145-15824.104=0.041
σ0.118-0.130=-0.011
min15824.046-15823.995=0.050
max15824.300-15824.292=0.008
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1585.000=61.000
σ0.000
min1646.000-1585.000=61.000
max1646.000-1585.000=61.000
mean26.655-26.592=0.063
σ0.146-0.051=0.096
min26.516-26.518=-0.002
max26.817-26.630=0.187