Compare commits

Home / Compare d86ced22 .. 3fb918aa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime (s)time_s
cache=disabled
datapoints=1
iterations=10
mean1223.191-1223.193=-0.002
σ2.289-2.284=0.004
min1222.326-1222.327=-0.000
max1229.612-1229.603=0.008
mean3755.000-3745.000=10.000
σ0.000
min3755.000-3745.000=10.000
max3755.000-3745.000=10.000
mean0.348
σ0.012
min0.329
max0.362
mean0.356
σ0.006
min0.338
max0.360
cache=enabled
datapoints=1
iterations=10
mean82.804-82.805=-0.001
σ0.002-0.002=0.000
min82.801-82.802=-0.001
max82.808-82.809=-0.001
mean3755.000-3745.000=10.000
σ0.000
min3755.000-3745.000=10.000
max3755.000-3745.000=10.000
mean0.041
σ0.004
min0.040
max0.052
mean0.041
σ0.004
min0.039
max0.053

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime (s)time_s
datapoints=1
iterations=20
mean1753.900-1753.901=-0.001
σ0.371-0.370=0.001
min1753.328-1753.328=-0.000
max1754.492-1754.489=0.003
mean1662.050-1656.100=5.950
σ652.268-641.140=11.128
min654.000-613.000=41.000
max2825.000-2629.000=196.000
mean2.738
σ0.205
min2.174
max3.256
mean2.735
σ0.162
min2.438
max3.051

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime (s)time_s
iters=5
new-facts=1
prior-facts=1
mean190.720-190.718=0.002
σ0.015-0.006=0.009
min190.706-190.712=-0.006
max190.741-190.729=0.012
mean2825.000-2629.000=196.000
σ0.000
min2825.000-2629.000=196.000
max2825.000-2629.000=196.000
mean0.277
σ0.001
min0.275
max0.278
mean0.278
σ0.000
min0.277
max0.279
iters=5
new-facts=1
prior-facts=6402
mean1989.498-1989.493=0.004
σ0.016-0.009=0.007
min1989.479-1989.483=-0.003
max1989.510-1989.501=0.009
mean2825.000-2629.000=196.000
σ0.000
min2825.000-2629.000=196.000
max2825.000-2629.000=196.000
mean2.710
σ0.151
min2.545
max2.905
mean2.604
σ0.106
min2.501
max2.770
iters=5
new-facts=6402
prior-facts=1
mean4880.180-4880.173=0.008
σ0.577-0.556=0.021
min4879.883-4879.885=-0.003
max4881.209-4881.159=0.050
mean2825.000-2629.000=196.000
σ0.000
min2825.000-2629.000=196.000
max2825.000-2629.000=196.000
mean8.075
σ0.222
min7.763
max8.389
mean8.040
σ0.099
min7.903
max8.147
iters=5
new-facts=6402
prior-facts=6402
mean4891.784-4891.786=-0.001
σ0.009-0.011=-0.002
min4891.775-4891.770=0.005
max4891.798-4891.798=-0.001
mean3321.800-3284.000=37.800
σ440.965-496.066=-55.101
min2825.000-2629.000=196.000
max3755.000-3745.000=10.000
mean8.170
σ0.232
min7.979
max8.504
mean8.019
σ0.105
min7.941
max8.201

newProductH/cdr_auton/broker

Factortime (s)time_s
iterations=5
mean1.313
σ0.327
min0.940
max1.780
mean1.287
σ0.330
min0.952
max1.802

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime (s)time_s
policies=2
mean456.475-456.477=-0.003
σ572.536-572.534=0.002
min170.204-170.210=-0.006
max1315.278-1315.278=-0.000
mean79.500
σ7.000
min76.000
max90.000
mean430.500
σ0.577
min430.000
max431.000
mean0.560
σ0.582
min0.263
max1.433
mean0.560
σ0.582
min0.261
max1.433
policies=20
mean1702.574-1702.590=-0.015
σ0.303-0.300=0.003
min1702.347-1702.358=-0.010
max1703.017-1703.027=-0.010
mean760.000
σ0.000
min760.000
max760.000
mean443.500-444.000=-0.500
σ11.240-11.804=-0.564
min431.000
max453.000-454.000=-1.000
mean2.602
σ0.006
min2.594
max2.609
mean2.608
σ0.006
min2.600
max2.615
policies=200
mean17035.383-17035.425=-0.042
σ0.134-0.051=0.084
min17035.192-17035.350=-0.158
max17035.508-17035.461=0.048
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.750-489.750=-1.000
σ2.986-3.500=-0.514
min485.000-486.000=-1.000
max492.000-494.000=-2.000
mean26.331
σ0.091
min26.231
max26.449
mean26.272
σ0.046
min26.230
max26.320