Compare commits

Home / Compare 5e5e7707 .. 659173f2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973
σ0.107
min35.923
max36.275
mean412.000
σ0.000
min412.000
max412.000
mean0.075
σ0.004
min0.071
max0.083
cache=y
dps=1
iters=10
policies=100
mean26.209
σ0.004
min26.203
max26.216
mean412.000
σ0.000
min412.000
max412.000
mean0.061
σ0.003
min0.058
max0.069

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.378-1754.046=4.332
σ0.373-0.365=0.008
min1757.802-1753.467=4.335
max1758.988-1754.643=4.344
mean1640.000-1666.350=-26.350
σ605.723-631.503=-25.780
min678.000-670.000=8.000
max2554.000-2629.000=-75.000
mean2.370-2.732=-0.362
σ0.142-0.198=-0.056
min2.244-2.181=0.063
max2.883-3.054=-0.171

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.558-190.713=88.845
σ0.008-0.005=0.003
min279.547-190.708=88.839
max279.567-190.719=88.848
mean2554.000-2629.000=-75.000
σ0.000
min2554.000-2629.000=-75.000
max2554.000-2629.000=-75.000
mean0.410-0.281=0.129
σ0.006-0.001=0.005
min0.405-0.279=0.125
max0.420-0.282=0.138
iters=5
new-facts=1
prior-facts=6402
mean2178.491-1989.499=188.992
σ0.006-0.014=-0.008
min2178.486-1989.486=188.999
max2178.501-1989.518=188.983
mean2554.000-2629.000=-75.000
σ0.000
min2554.000-2629.000=-75.000
max2554.000-2629.000=-75.000
mean3.415-2.413=1.002
σ0.106-0.076=0.030
min3.269-2.319=0.949
max3.546-2.532=1.014
iters=5
new-facts=6402
prior-facts=1
mean5056.400-4879.963=176.436
σ0.974-0.611=0.363
min5055.856-4879.443=176.413
max5058.134-4881.017=177.117
mean2554.000-2629.000=-75.000
σ0.000
min2554.000-2629.000=-75.000
max2554.000-2629.000=-75.000
mean8.914-8.127=0.787
σ0.507-0.204=0.303
min8.156-7.810=0.346
max9.416-8.362=1.054
iters=5
new-facts=6402
prior-facts=6402
mean5193.802-4891.693=302.109
σ0.086-0.093=-0.007
min5193.730-4891.616=302.114
max5193.900-4891.797=302.103
mean3232.000-3249.600=-17.600
σ368.640-399.196=-30.556
min2713.000-2845.000=-132.000
max3677.000-3643.000=34.000
mean8.929-8.208=0.721
σ0.449-0.218=0.230
min8.663-8.026=0.638
max9.724-8.567=1.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.298-1.764=-0.466
σ0.370-0.156=0.215
min0.961-1.491=-0.530
max1.875-1.877=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.536-456.477=9.059
σ572.658-572.533=0.125
min179.203-170.209=8.993
max1324.523-1315.277=9.246
mean79.500
σ7.000
min76.000
max90.000
mean2554.000-430.500=2123.500
σ0.000-0.577=-0.577
min2554.000-430.000=2124.000
max2554.000-431.000=2123.000
mean0.551-0.536=0.015
σ0.539-0.533=0.007
min0.279-0.263=0.016
max1.360-1.335=0.025
policies=20
mean1792.280-1702.596=89.684
σ0.351-0.316=0.036
min1792.051-1702.365=89.687
max1792.802-1703.059=89.743
mean760.000
σ0.000
min760.000
max760.000
mean2554.000-444.250=2109.750
σ0.000-11.615=-11.615
min2554.000-431.000=2123.000
max2554.000-454.000=2100.000
mean2.787-2.620=0.166
σ0.014-0.022=-0.009
min2.772-2.592=0.180
max2.805-2.647=0.158
policies=200
mean17929.582-17035.409=894.173
σ0.511-0.068=0.443
min17929.282-17035.331=893.951
max17930.343-17035.497=894.846
mean7600.000
σ0.000
min7600.000
max7600.000
mean2554.000-491.500=2062.500
σ0.000-3.873=-3.873
min2554.000-487.000=2067.000
max2554.000-496.000=2058.000
mean28.210-26.457=1.752
σ0.177-0.101=0.076
min28.046-26.352=1.694
max28.382-26.553=1.829