Compare commits

Home / Compare a9abb6d9 .. 1fe49223

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.703-53.703=-0.001
σ0.366-0.369=-0.003
min53.561-53.562=-0.001
max54.745-54.754=-0.009
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.137-0.139=-0.001
σ0.005-0.004=0.001
min0.130-0.134=-0.004
max0.146-0.145=0.000
cache=y
dps=1
iters=10
policies=100
mean43.059-43.057=0.002
σ0.007-0.006=0.001
min43.050-43.045=0.005
max43.070-43.069=0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.121-0.121=0.000
σ0.004-0.004=-0.000
min0.117-0.113=0.004
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1005.104-1005.107=-0.004
σ0.894-0.883=0.011
min1004.638-1004.632=0.006
max1008.817-1008.763=0.054
mean1052.050-1049.850=2.200
σ321.560-321.397=0.163
min550.000-549.000=1.000
max1632.000
mean1.642-1.635=0.007
σ0.093-0.088=0.004
min1.551-1.501=0.050
max1.888-1.855=0.033

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.883=-0.000
σ0.002-0.002=-0.000
min0.881
max0.886-0.886=-0.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.410-0.412=-0.001
σ0.100-0.136=-0.036
min0.345-0.327=0.018
max0.587-0.654=-0.067
name=error_case.art
mean2.333
σ0.003
min2.332
max2.337
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.872-0.880=-0.008
σ0.064-0.083=-0.019
min0.823-0.829=-0.007
max0.981-1.026=-0.046
name=heavy_item.art
mean1.521-1.522=-0.001
σ0.002-0.001=0.000
min1.520
max1.524
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.543-0.536=0.007
σ0.057-0.054=0.003
min0.507-0.486=0.021
max0.641-0.623=0.018
name=nested_use.art
mean2.355-2.356=-0.000
σ0.002-0.002=0.000
min2.355
max2.358
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.850-0.867=-0.017
σ0.044-0.035=0.009
min0.813-0.840=-0.027
max0.921-0.928=-0.007

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.551-963.552=-0.001
σ0.025-0.023=0.002
min963.524-963.536=-0.012
max963.589-963.591=-0.002
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.822-0.833=-0.012
σ0.024-0.029=-0.005
min0.798-0.799=-0.001
max0.859-0.862=-0.003
name=cdr_enhanced_4k_loc.art
mean884.855-884.853=0.001
σ0.008-0.008=-0.000
min884.847
max884.866-884.866=-0.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.711-0.727=-0.016
σ0.030-0.032=-0.002
min0.674-0.671=0.003
max0.738-0.748=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.711-7.711=0.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean4.225-4.264=-0.039
σ0.116-0.073=0.042
min4.043-4.146=-0.103
max4.867-4.535=0.333
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1632.000
σ0.000
min1632.000
max1632.000
mean4.175-4.238=-0.063
σ0.072-0.077=-0.006
min4.057-4.119=-0.062
max4.457-4.536=-0.080
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.751-0.750=0.000
σ0.018-0.018=0.001
min0.722-0.672=0.050
max0.877-0.842=0.035
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.710-0.697=0.013
σ0.014-0.039=-0.025
min0.678-0.508=0.171
max0.767-0.796=-0.029

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean294.360-294.340=0.020
σ0.245-0.265=-0.020
min294.193-294.171=0.022
max295.039-295.079=-0.040
mean1942.000-1964.000=-22.000
σ0.000
min1942.000-1964.000=-22.000
max1942.000-1964.000=-22.000
mean0.580-0.561=0.019
σ0.050-0.045=0.005
min0.503-0.510=-0.007
max0.672-0.634=0.037

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean281.493-281.487=0.006
σ0.040-0.039=0.002
min281.441-281.431=0.010
max281.538-281.524=0.014
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.394-0.387=0.007
σ0.009-0.004=0.004
min0.383-0.381=0.003
max0.403-0.391=0.012
iters=5
new-facts=1
prior-facts=6402
mean1291.479-1291.440=0.039
σ0.115-0.083=0.032
min1291.354-1291.348=0.006
max1291.618-1291.568=0.049
mean1632.000
σ0.000
min1632.000
max1632.000
mean1.992-1.952=0.041
σ0.171-0.151=0.020
min1.764-1.751=0.013
max2.241-2.162=0.079
iters=5
new-facts=6402
prior-facts=1
mean1534.365-1534.428=-0.064
σ3.950-3.931=0.019
min1532.367-1532.540=-0.173
max1541.423-1541.455=-0.031
mean1632.000
σ0.000
min1632.000
max1632.000
mean2.318-2.409=-0.092
σ0.262-0.295=-0.032
min2.040-2.169=-0.129
max2.695-2.913=-0.218
iters=5
new-facts=6402
prior-facts=6402
mean1853.353-1853.367=-0.014
σ0.060-0.065=-0.005
min1853.301-1853.291=0.010
max1853.436-1853.435=0.001
mean1788.600-1796.200=-7.600
σ150.774-165.352=-14.578
min1632.000
max1942.000-1964.000=-22.000
mean2.992-3.176=-0.184
σ0.110-0.273=-0.163
min2.856-2.840=0.017
max3.112-3.551=-0.439

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.408-1.430=-0.022
σ0.246-0.366=-0.120
min1.265-1.108=0.157
max1.842-1.913=-0.072

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean442.427-442.427=0.001
σ577.065-577.065=-0.000
min153.894-153.892=0.002
max1308.024-1308.024=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean0.522-0.540=-0.017
σ0.531-0.562=-0.030
min0.256-0.256=0.001
max1.320-1.383=-0.063
policies=20
mean1539.207-1539.204=0.002
σ0.319-0.317=0.002
min1538.983-1538.985=-0.002
max1539.680-1539.675=0.005
mean920.000
σ0.000
min920.000
max920.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean2.570-2.567=0.004
σ0.018-0.008=0.010
min2.557-2.557=0.000
max2.597-2.575=0.022
policies=200
mean15400.368-15400.408=-0.040
σ0.128-0.162=-0.034
min15400.222-15400.291=-0.069
max15400.526-15400.640=-0.114
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000
σ0.000
min1632.000
max1632.000
mean25.958-26.080=-0.122
σ0.033-0.221=-0.188
min25.932-25.888=0.045
max26.006-26.358=-0.353