Compare commits

Home / Compare 2fe95a3a .. 01ea7729

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.044-54.041=0.003
σ0.370-0.370=0.000
min53.893-53.896=-0.003
max55.096-55.094=0.003
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.136-0.141=-0.005
σ0.006-0.004=0.002
min0.130-0.137=-0.007
max0.147-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.385-43.384=0.001
σ0.006-0.007=-0.000
min43.374-43.375=-0.000
max43.396-43.400=-0.004
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.123-0.123=0.001
σ0.003-0.003=-0.000
min0.120-0.120=0.000
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.979-1006.974=0.005
σ0.878-0.883=-0.005
min1006.482-1006.509=-0.027
max1010.612-1010.636=-0.024
mean1051.300-1046.900=4.400
σ310.712-315.878=-5.166
min555.000-576.000=-21.000
max1650.000-1644.000=6.000
mean1.558-1.576=-0.018
σ0.065-0.126=-0.062
min1.458-1.472=-0.014
max1.719-2.047=-0.328

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.001
σ0.003-0.003=-0.000
min0.882
max0.888-0.888=-0.000
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.421-0.419=0.002
σ0.143-0.142=0.001
min0.335-0.335=-0.001
max0.676-0.670=0.006
name=error_case.art
mean2.339-2.340=-0.001
σ0.003-0.003=-0.001
min2.337
max2.342-2.344=-0.002
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.887-0.877=0.010
σ0.094-0.089=0.005
min0.806-0.819=-0.013
max1.046-1.034=0.012
name=heavy_item.art
mean1.524-1.523=0.001
σ0.002-0.001=0.000
min1.522
max1.526-1.525=0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.536-0.525=0.012
σ0.043-0.052=-0.009
min0.498-0.488=0.010
max0.605-0.617=-0.012
name=nested_use.art
mean2.361-2.362=-0.000
σ0.002-0.002=-0.000
min2.360
max2.364
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.863-0.862=0.001
σ0.030-0.076=-0.046
min0.835-0.809=0.027
max0.911-0.994=-0.083

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.831-964.831=-0.000
σ0.022-0.027=-0.006
min964.810-964.803=0.007
max964.865-964.871=-0.005
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.764-0.805=-0.041
σ0.044-0.040=0.004
min0.716-0.756=-0.040
max0.809-0.863=-0.054
name=cdr_enhanced_4k_loc.art
mean885.513-885.514=-0.001
σ0.006-0.005=0.002
min885.504-885.508=-0.004
max885.519-885.520=-0.001
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.705-0.718=-0.013
σ0.032-0.031=0.000
min0.666-0.668=-0.001
max0.741-0.744=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.719
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean4.088-4.247=-0.160
σ0.331-0.099=0.232
min3.436-4.090=-0.654
max4.605-4.815=-0.209
name=record_render_large_syntax_err.art
mean7.665-7.665=0.000
σ0.002-0.002=0.000
min7.664
max7.668
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean4.302-4.195=0.106
σ0.096-0.084=0.012
min4.102-4.056=0.047
max4.642-4.482=0.160
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.742-0.672=0.070
σ0.020-0.093=-0.073
min0.714-0.504=0.210
max0.873-0.856=0.018
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.703-0.505=0.198
σ0.016-0.026=-0.010
min0.675-0.478=0.197
max0.771-0.636=0.135

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.629-295.526=0.103
σ0.230-0.228=0.002
min295.391-295.383=0.009
max296.229-296.132=0.097
mean1948.000-1897.000=51.000
σ0.000
min1948.000-1897.000=51.000
max1948.000-1897.000=51.000
mean0.541-0.592=-0.051
σ0.044-0.023=0.021
min0.497-0.560=-0.063
max0.609-0.617=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.407-285.415=-0.007
σ0.035-0.039=-0.004
min285.361-285.361=-0.001
max285.442-285.454=-0.011
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.386-0.396=-0.010
σ0.007-0.008=-0.001
min0.381-0.388=-0.007
max0.398-0.407=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1295.791-1295.800=-0.009
σ0.100-0.116=-0.016
min1295.674-1295.670=0.005
max1295.897-1295.948=-0.051
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean1.920-1.884=0.035
σ0.054-0.133=-0.079
min1.869-1.711=0.158
max2.001-2.018=-0.017
iters=5
new-facts=6402
prior-facts=1
mean1539.924-1539.941=-0.017
σ6.898-6.878=0.020
min1536.615-1536.620=-0.005
max1552.256-1552.239=0.018
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean2.331-2.336=-0.005
σ0.232-0.206=0.026
min2.105-1.984=0.121
max2.716-2.472=0.243
iters=5
new-facts=6402
prior-facts=6402
mean1857.725-1857.699=0.026
σ0.068-0.056=0.012
min1857.641-1857.649=-0.008
max1857.797-1857.782=0.014
mean1795.000-1767.800=27.200
σ149.268-123.380=25.888
min1650.000-1644.000=6.000
max1948.000-1897.000=51.000
mean3.223-3.080=0.143
σ0.399-0.248=0.151
min2.879-2.863=0.016
max3.847-3.499=0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.336-1.341=-0.005
σ0.264-0.244=0.021
min1.105-1.108=-0.003
max1.791-1.755=0.036

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.741-445.741=-0.000
σ580.934-580.934=0.000
min155.272-155.273=-0.001
max1317.142-1317.142=-0.000
mean96.250
σ8.500
min92.000
max109.000
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean0.541-0.554=-0.012
σ0.561-0.585=-0.024
min0.257-0.256=0.001
max1.382-1.431=-0.048
policies=20
mean1552.988-1552.991=-0.003
σ0.344-0.328=0.016
min1552.758-1552.767=-0.009
max1553.499-1553.478=0.021
mean920.000
σ0.000
min920.000
max920.000
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean2.607-2.579=0.028
σ0.037-0.024=0.012
min2.570-2.557=0.013
max2.656-2.614=0.042
policies=200
mean15537.959-15537.952=0.008
σ0.061-0.089=-0.028
min15537.875-15537.852=0.023
max15538.020-15538.059=-0.039
mean9200.000
σ0.000
min9200.000
max9200.000
mean1650.000-1644.000=6.000
σ0.000
min1650.000-1644.000=6.000
max1650.000-1644.000=6.000
mean26.164-26.172=-0.008
σ0.153-0.151=0.003
min26.027-25.984=0.044
max26.380-26.349=0.032