Compare commits

Home / Compare 91597c73 .. 26b344b0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.056-54.057=-0.000
σ0.368-0.368=-0.000
min53.911-53.911=-0.000
max55.102-55.104=-0.002
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.141-0.138=0.003
σ0.003-0.003=0.000
min0.138-0.133=0.004
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.394-43.394=0.000
σ0.006-0.006=-0.000
min43.387-43.386=0.002
max43.404-43.405=-0.001
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.121-0.122=-0.001
σ0.004-0.004=-0.000
min0.115-0.119=-0.003
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.983-1006.986=-0.003
σ0.861-0.851=0.010
min1006.482-1006.482=-0.000
max1010.540-1010.485=0.055
mean1050.100-1046.300=3.800
σ313.996-313.787=0.209
min580.000-577.000=3.000
max1644.000-1639.000=5.000
mean1.526-1.537=-0.012
σ0.078-0.081=-0.003
min1.451-1.391=0.061
max1.770-1.730=0.040

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.002
min0.882
max0.887
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.402-0.406=-0.004
σ0.100-0.100=-0.001
min0.346-0.344=0.002
max0.579-0.582=-0.004
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.882-0.901=-0.019
σ0.086-0.087=-0.001
min0.825-0.834=-0.008
max1.034-1.048=-0.014
name=heavy_item.art
mean1.523
σ0.001
min1.522
max1.525
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.534-0.547=-0.012
σ0.052-0.039=0.013
min0.495-0.512=-0.018
max0.625-0.613=0.011
name=nested_use.art
mean2.362
σ0.002
min2.360
max2.364
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.854-0.850=0.005
σ0.033-0.037=-0.004
min0.825-0.809=0.016
max0.908-0.910=-0.003

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.835=-0.004
σ0.025-0.030=-0.006
min964.802-964.808=-0.006
max964.861-964.886=-0.025
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.828-0.784=0.044
σ0.034-0.059=-0.025
min0.789-0.694=0.095
max0.858-0.851=0.007
name=cdr_enhanced_4k_loc.art
mean885.515-885.515=-0.000
σ0.008-0.008=0.001
min885.504
max885.525-885.522=0.003
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.664-0.718=-0.054
σ0.056-0.028=0.028
min0.606-0.672=-0.066
max0.729-0.743=-0.014

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.722-7.720=0.001
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean4.226-4.247=-0.020
σ0.072-0.095=-0.023
min4.084-4.097=-0.013
max4.554-4.566=-0.012
name=record_render_large_syntax_err.art
mean7.665-7.665=-0.000
σ0.002-0.002=-0.000
min7.664
max7.668
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean4.236-4.217=0.019
σ0.089-0.078=0.011
min4.092-4.054=0.038
max4.509-4.464=0.044
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.750-0.749=0.001
σ0.018-0.018=-0.000
min0.712-0.720=-0.008
max0.859-0.857=0.002
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.708-0.707=0.001
σ0.016-0.016=0.000
min0.673-0.676=-0.003
max0.784-0.798=-0.014

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.562-295.415=0.147
σ0.259-0.195=0.064
min295.368-295.214=0.154
max296.277-295.913=0.364
mean1925.000-1939.000=-14.000
σ0.000
min1925.000-1939.000=-14.000
max1925.000-1939.000=-14.000
mean0.567-0.579=-0.012
σ0.043-0.060=-0.017
min0.506-0.499=0.007
max0.661-0.705=-0.045

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.409=0.003
σ0.034-0.037=-0.003
min285.365-285.360=0.005
max285.445-285.448=-0.003
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.398-0.386=0.012
σ0.007-0.006=0.001
min0.391-0.381=0.010
max0.406-0.393=0.013
iters=5
new-facts=1
prior-facts=6402
mean1295.792-1295.792=-0.001
σ0.103-0.099=0.004
min1295.678
max1295.930-1295.896=0.035
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean1.892-1.946=-0.054
σ0.088-0.132=-0.044
min1.809-1.808=0.001
max2.019-2.112=-0.093
iters=5
new-facts=6402
prior-facts=1
mean1539.941-1539.951=-0.010
σ6.871-6.843=0.028
min1536.681-1536.722=-0.041
max1552.229-1552.189=0.040
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean2.150-2.129=0.021
σ0.162-0.162=0.000
min2.045-2.007=0.038
max2.436-2.396=0.040
iters=5
new-facts=6402
prior-facts=6402
mean1857.706-1857.712=-0.006
σ0.062-0.062=0.000
min1857.645-1857.643=0.002
max1857.798-1857.789=0.008
mean1780.200-1785.400=-5.200
σ140.829-149.783=-8.954
min1644.000-1639.000=5.000
max1925.000-1939.000=-14.000
mean2.984-2.939=0.045
σ0.119-0.084=0.035
min2.820-2.851=-0.030
max3.104-3.059=0.045

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.410-1.304=0.106
σ0.307-0.267=0.039
min1.106-1.105=0.001
max1.883-1.758=0.125

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.739-445.740=-0.001
σ580.934-580.935=-0.001
min155.271-155.270=0.001
max1317.141-1317.143=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean0.538-0.527=0.011
σ0.562-0.528=0.033
min0.256-0.258=-0.002
max1.381-1.320=0.061
policies=20
mean1552.977-1552.997=-0.020
σ0.328-0.341=-0.014
min1552.750-1552.765=-0.015
max1553.464-1553.504=-0.041
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean2.593-2.605=-0.012
σ0.032-0.050=-0.017
min2.553-2.567=-0.014
max2.630-2.678=-0.048
policies=200
mean15537.969-15538.024=-0.055
σ0.092-0.088=0.004
min15537.836-15537.922=-0.087
max15538.040-15538.137=-0.097
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1639.000=5.000
σ0.000
min1644.000-1639.000=5.000
max1644.000-1639.000=5.000
mean26.092-26.141=-0.049
σ0.069-0.095=-0.026
min26.022-26.074=-0.051
max26.187-26.280=-0.094