Compare commits

Home / Compare 5de24216 .. d911dcd1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.719
σ0.664
min35.931
max37.523
mean3969.000
σ0.000
min3969.000
max3969.000
mean0.070
σ0.001
min0.070
max0.072
cache=y
dps=1
iters=10
policies=100
mean26.711
σ0.646
min26.204
max27.465
mean3969.000
σ0.000
min3969.000
max3969.000
mean0.059
σ0.002
min0.057
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1756.290=0.068
σ0.372-0.369=0.003
min1755.784-1755.723=0.061
max1756.951-1756.885=0.066
mean1661.050-1655.700=5.350
σ629.798-627.562=2.235
min611.000-682.000=-71.000
max2633.000-2606.000=27.000
mean2.288-2.262=0.027
σ0.177-0.077=0.100
min2.139-2.056=0.084
max2.779-2.370=0.409

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.674-278.675=-0.001
σ0.007-0.011=-0.004
min278.666-278.660=0.006
max278.682-278.689=-0.007
mean2633.000-2606.000=27.000
σ0.000
min2633.000-2606.000=27.000
max2633.000-2606.000=27.000
mean0.417-0.420=-0.003
σ0.001-0.002=-0.001
min0.415-0.417=-0.002
max0.418-0.422=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.848-2268.844=0.003
σ0.005-0.013=-0.008
min2268.841-2268.828=0.012
max2268.854-2268.863=-0.009
mean2633.000-2606.000=27.000
σ0.000
min2633.000-2606.000=27.000
max2633.000-2606.000=27.000
mean2.949-3.085=-0.136
σ0.114-0.335=-0.221
min2.873-2.885=-0.011
max3.150-3.670=-0.520
iters=5
new-facts=6402
prior-facts=1
mean4952.328-4952.098=0.230
σ0.771-0.920=-0.150
min4951.941-4951.378=0.562
max4953.705-4953.710=-0.005
mean2633.000-2606.000=27.000
σ0.000
min2633.000-2606.000=27.000
max2633.000-2606.000=27.000
mean7.890-8.012=-0.121
σ0.145-0.262=-0.116
min7.752-7.811=-0.059
max8.119-8.451=-0.332
iters=5
new-facts=6402
prior-facts=6402
mean5166.909-5166.884=0.024
σ0.196-0.201=-0.005
min5166.686-5166.546=0.140
max5167.055-5167.046=0.009
mean3411.800-3492.200=-80.400
σ454.012-481.290=-27.277
min2776.000-2865.000=-89.000
max3969.000-4164.000=-195.000
mean9.414-9.338=0.076
σ0.275-0.221=0.053
min9.128-9.026=0.102
max9.866-9.637=0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.081-1.032=0.048
σ0.173-0.131=0.042
min0.944-0.945=-0.001
max1.368-1.244=0.125

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.254-460.253=0.001
σ572.608-572.606=0.002
min173.949-173.949=0.000
max1319.166-1319.163=0.004
mean79.500
σ7.000
min76.000
max90.000
mean432.000-436.000=-4.000
σ0.000
min432.000-436.000=-4.000
max432.000-436.000=-4.000
mean0.550-0.558=-0.008
σ0.562-0.576=-0.014
min0.267-0.263=0.004
max1.392-1.421=-0.029
policies=20
mean1740.001-1740.004=-0.003
σ0.329-0.336=-0.007
min1739.762-1739.758=0.004
max1740.484-1740.497=-0.013
mean760.000
σ0.000
min760.000
max760.000
mean445.500-446.500=-1.000
σ12.369-9.950=2.419
min432.000-436.000=-4.000
max462.000-455.000=7.000
mean2.661-2.679=-0.017
σ0.011-0.006=0.005
min2.649-2.670=-0.021
max2.676-2.683=-0.007
policies=200
mean17409.335-17409.320=0.015
σ0.062-0.072=-0.010
min17409.289-17409.262=0.027
max17409.425-17409.424=0.001
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.500-491.250=-1.750
σ2.380-2.217=0.163
min487.000-489.000=-2.000
max492.000-494.000=-2.000
mean26.910-26.917=-0.007
σ0.038-0.129=-0.091
min26.875-26.750=0.124
max26.964-27.032=-0.067