Compare commits

Home / Compare c0ee6292 .. f3e892be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.054-54.055=-0.001
σ0.370-0.367=0.003
min53.909-53.909=-0.001
max55.108-55.100=0.008
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.140-0.141=-0.001
σ0.005-0.004=0.001
min0.132-0.138=-0.006
max0.147-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.007-0.007=0.000
min43.384-43.385=-0.001
max43.407-43.410=-0.002
mean415.000-420.000=-5.000
σ0.000
min415.000-420.000=-5.000
max415.000-420.000=-5.000
mean0.121-0.123=-0.002
σ0.004-0.004=0.001
min0.115-0.120=-0.004
max0.130-0.129=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.005=-0.000
σ1.200-1.201=-0.001
min1006.443-1006.459=-0.017
max1012.039-1012.038=0.001
mean1050.200-1055.250=-5.050
σ309.011-307.841=1.170
min574.000-580.000=-6.000
max1647.000
mean1.557-1.551=0.006
σ0.080-0.086=-0.006
min1.481-1.418=0.063
max1.777-1.783=-0.006

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.884=-0.000
σ0.003-0.002=0.000
min0.882
max0.887
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.419-0.419=0.000
σ0.137-0.132=0.005
min0.332-0.347=-0.014
max0.661-0.654=0.007
name=error_case.art
mean2.339-2.339=-0.000
σ0.002-0.003=-0.000
min2.337
max2.342-2.342=-0.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.865-0.895=-0.030
σ0.099-0.104=-0.005
min0.802-0.827=-0.025
max1.039-1.076=-0.036
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.522-0.544=-0.022
σ0.050-0.052=-0.002
min0.486-0.505=-0.019
max0.607-0.632=-0.025
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.838-0.890=-0.052
σ0.040-0.060=-0.020
min0.795-0.834=-0.039
max0.901-0.977=-0.076

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.834=0.005
σ0.035-0.030=0.004
min964.811-964.810=0.001
max964.897-964.886=0.011
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.842-0.828=0.013
σ0.031-0.042=-0.011
min0.788-0.760=0.028
max0.865-0.857=0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.007-0.004=0.003
min885.504-885.505=-0.001
max885.523-885.516=0.007
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.726-0.721=0.005
σ0.030-0.038=-0.008
min0.675-0.654=0.022
max0.753-0.740=0.013

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.720-7.721=-0.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.208-4.249=-0.041
σ0.090-0.096=-0.007
min4.046-4.111=-0.064
max4.575-4.769=-0.193
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000
σ0.000
min1647.000
max1647.000
mean4.215-4.209=0.006
σ0.092-0.068=0.025
min4.030-4.081=-0.051
max4.599-4.443=0.156
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.739-0.744=-0.005
σ0.018-0.017=0.001
min0.700-0.716=-0.016
max0.848-0.851=-0.004
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.694-0.701=-0.007
σ0.016-0.019=-0.002
min0.665-0.662=0.002
max0.785-0.795=-0.010

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.833-297.003=-0.170
σ0.221-0.258=-0.037
min296.701-296.849=-0.147
max297.428-297.709=-0.281
mean1902.000-1904.000=-2.000
σ0.000
min1902.000-1904.000=-2.000
max1902.000-1904.000=-2.000
mean0.587-0.591=-0.003
σ0.054-0.039=0.015
min0.509-0.539=-0.030
max0.702-0.679=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.820-286.828=-0.007
σ0.037-0.038=-0.001
min286.770-286.781=-0.011
max286.857-286.873=-0.016
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.393-0.401=-0.007
σ0.006-0.009=-0.003
min0.386-0.391=-0.005
max0.400-0.412=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1297.271-1297.273=-0.002
σ0.091-0.081=0.009
min1297.158-1297.197=-0.038
max1297.397-1297.388=0.009
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.269-2.198=0.071
σ0.159-0.080=0.079
min2.139-2.067=0.072
max2.544-2.261=0.282
iters=5
new-facts=6402
prior-facts=1
mean1541.344-1541.337=0.006
σ6.841-6.833=0.008
min1538.091-1538.121=-0.030
max1553.578-1553.558=0.020
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.242-2.221=0.022
σ0.170-0.132=0.038
min2.130-2.112=0.018
max2.544-2.393=0.151
iters=5
new-facts=6402
prior-facts=6402
mean1859.119-1859.112=0.006
σ0.066-0.067=-0.001
min1859.030-1859.033=-0.002
max1859.196-1859.193=0.003
mean1777.400-1781.000=-3.600
σ125.801-125.178=0.623
min1647.000
max1902.000-1904.000=-2.000
mean3.123-3.097=0.026
σ0.285-0.321=-0.036
min2.833-2.754=0.079
max3.550-3.532=0.019

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.194-1.293=-0.099
σ0.318-0.316=0.002
min0.930-0.938=-0.008
max1.612-1.745=-0.133

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.371=0.001
min158.134-158.133=0.001
max1320.879-1320.877=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean0.562-0.552=0.010
σ0.598-0.579=0.019
min0.261-0.260=0.001
max1.459-1.420=0.039
policies=20
mean1581.629-1581.616=0.013
σ0.360-0.338=0.021
min1581.386-1581.388=-0.002
max1582.163-1582.119=0.045
mean920.000
σ0.000
min920.000
max920.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean2.638-2.634=0.004
σ0.014-0.013=0.001
min2.630-2.621=0.009
max2.659-2.649=0.010
policies=200
mean15824.126-15824.167=-0.040
σ0.166-0.102=0.065
min15824.024-15824.034=-0.011
max15824.373-15824.260=0.112
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000
σ0.000
min1647.000
max1647.000
mean26.630-26.706=-0.076
σ0.038-0.117=-0.079
min26.603-26.616=-0.013
max26.686-26.868=-0.181