Compare commits

Home / Compare 7041cd83 .. 08a28d67

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.013-54.014=-0.001
σ0.369-0.369=-0.001
min53.874-53.871=0.003
max55.062-55.065=-0.003
mean416.000-418.700=-2.700
σ0.000-0.483=-0.483
min416.000-418.000=-2.000
max416.000-419.000=-3.000
mean0.136-0.139=-0.003
σ0.005-0.003=0.002
min0.129-0.136=-0.007
max0.147-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.006-0.007=-0.001
min43.314-43.310=0.004
max43.333-43.335=-0.002
mean416.000-419.000=-3.000
σ0.000
min416.000-419.000=-3.000
max416.000-419.000=-3.000
mean0.121-0.121=0.001
σ0.003-0.005=-0.002
min0.119-0.114=0.005
max0.128-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1011.003=-4.694
σ1.169-1.158=0.012
min1005.773-1010.462=-4.689
max1011.207-1015.850=-4.643
mean1047.400-1049.150=-1.750
σ314.403-316.981=-2.577
min577.000-585.000=-8.000
max1644.000-1655.000=-11.000
mean1.573-1.552=0.021
σ0.086-0.129=-0.043
min1.489-1.451=0.038
max1.811-2.033=-0.221

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.415
σ0.155
min0.325
max0.691
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.935
σ0.173
min0.839
max1.243
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.551
σ0.051
min0.513
max0.638
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.863
σ0.036
min0.836
max0.924

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.111
σ0.022
min964.083
max964.140
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.815
σ0.044
min0.766
max0.864
name=cdr_enhanced_4k_loc.art
mean884.716
σ0.006
min884.711
max884.726
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.732
σ0.024
min0.690
max0.748

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715
σ0.002
min7.714
max7.719
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.218
σ0.075
min4.093
max4.467
name=record_render_large_syntax_err.art
mean7.663
σ0.002
min7.662
max7.669
mean1644.000
σ0.000
min1644.000
max1644.000
mean4.226
σ0.087
min4.049
max4.476
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.746
σ0.029
min0.707
max0.873
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1644.000
σ0.000
min1644.000
max1644.000
mean0.695
σ0.017
min0.659
max0.784

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.319-300.997=-4.678
σ0.224-0.245=-0.021
min296.137-300.788=-4.651
max296.913-301.652=-4.739
mean1904.000-1959.000=-55.000
σ0.000
min1904.000-1959.000=-55.000
max1904.000-1959.000=-55.000
mean0.570-0.558=0.012
σ0.051-0.029=0.023
min0.502-0.504=-0.002
max0.674-0.589=0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-299.444=-14.749
σ0.039-0.052=-0.013
min284.642-299.371=-14.729
max284.739-299.501=-14.762
mean1644.000-1655.000=-11.000
σ0.000
min1644.000-1655.000=-11.000
max1644.000-1655.000=-11.000
mean0.397-0.389=0.008
σ0.011-0.006=0.005
min0.385-0.385=-0.001
max0.406-0.400=0.006
iters=5
new-facts=1
prior-facts=6402
mean1295.082-1309.874=-14.792
σ0.123-0.083=0.040
min1294.958-1309.768=-14.811
max1295.265-1309.990=-14.725
mean1644.000-1655.000=-11.000
σ0.000
min1644.000-1655.000=-11.000
max1644.000-1655.000=-11.000
mean1.919-1.897=0.023
σ0.103-0.081=0.021
min1.814-1.790=0.024
max2.066-2.016=0.049
iters=5
new-facts=6402
prior-facts=1
mean1539.192-1553.986=-14.795
σ6.836-6.891=-0.055
min1535.975-1550.682=-14.707
max1551.417-1566.308=-14.891
mean1644.000-1655.000=-11.000
σ0.000
min1644.000-1655.000=-11.000
max1644.000-1655.000=-11.000
mean2.167-2.302=-0.135
σ0.142-0.222=-0.080
min1.992-2.026=-0.034
max2.336-2.589=-0.253
iters=5
new-facts=6402
prior-facts=6402
mean1856.974-1871.768=-14.794
σ0.067-0.049=0.018
min1856.895-1871.702=-14.806
max1857.065-1871.809=-14.744
mean1773.400-1770.600=2.800
σ129.525-125.636=3.890
min1644.000-1655.000=-11.000
max1904.000-1959.000=-55.000
mean3.006-2.903=0.103
σ0.178-0.064=0.114
min2.866-2.835=0.031
max3.314-2.986=0.328

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.106-1.184=-0.078
σ0.207-0.292=-0.085
min0.927-0.927=0.000
max1.391-1.663=-0.271

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.785-447.809=-0.024
σ581.213-581.235=-0.022
min157.175-157.183=-0.008
max1319.605-1319.662=-0.057
mean96.250
σ8.500
min92.000
max109.000
mean1644.000-1655.000=-11.000
σ0.000
min1644.000-1655.000=-11.000
max1644.000-1655.000=-11.000
mean0.523-0.554=-0.031
σ0.531-0.591=-0.060
min0.256-0.248=0.008
max1.320-1.441=-0.122
policies=20
mean1572.099-1572.129=-0.030
σ0.351-0.333=0.018
min1571.860-1571.943=-0.083
max1572.621-1572.628=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1644.000-1655.000=-11.000
σ0.000
min1644.000-1655.000=-11.000
max1644.000-1655.000=-11.000
mean2.629-2.629=-0.000
σ0.015-0.011=0.003
min2.614-2.615=-0.002
max2.647-2.640=0.008
policies=200
mean15729.059-15729.043=0.015
σ0.053-0.043=0.009
min15728.992-15728.983=0.008
max15729.113-15729.085=0.028
mean9200.000
σ0.000
min9200.000
max9200.000
mean1644.000-1655.000=-11.000
σ0.000
min1644.000-1655.000=-11.000
max1644.000-1655.000=-11.000
mean26.531-26.597=-0.067
σ0.208-0.143=0.065
min26.357-26.455=-0.097
max26.827-26.755=0.072