Compare commits

Home / Compare dbb6a271 .. 7d916121

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956
σ0.102
min35.905
max36.245
mean414.000
σ0.000
min414.000
max414.000
mean0.076
σ0.004
min0.074
max0.083
cache=y
dps=1
iters=10
policies=100
mean26.203
σ0.005
min26.193
max26.208
mean414.000
σ0.000
min414.000
max414.000
mean0.061
σ0.003
min0.059
max0.068

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.305-1754.046=2.259
σ0.368-0.364=0.004
min1755.729-1753.469=2.260
max1756.897-1754.656=2.241
mean1655.050-1660.700=-5.650
σ630.068-638.727=-8.659
min619.000-624.000=-5.000
max2674.000-2632.000=42.000
mean2.370-2.777=-0.407
σ0.079-0.180=-0.101
min2.257-2.174=0.084
max2.561-3.066=-0.505

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.824-190.720=88.104
σ0.007-0.006=0.002
min278.812-190.712=88.100
max278.831-190.727=88.105
mean2674.000-2632.000=42.000
σ0.000
min2674.000-2632.000=42.000
max2674.000-2632.000=42.000
mean0.412-0.280=0.132
σ0.004-0.001=0.004
min0.407-0.279=0.128
max0.419-0.281=0.139
iters=5
new-facts=1
prior-facts=6402
mean2268.887-1989.501=279.387
σ0.007-0.016=-0.009
min2268.878-1989.482=279.396
max2268.893-1989.525=279.368
mean2674.000-2632.000=42.000
σ0.000
min2674.000-2632.000=42.000
max2674.000-2632.000=42.000
mean2.946-2.423=0.523
σ0.092-0.060=0.032
min2.881-2.328=0.552
max3.105-2.490=0.615
iters=5
new-facts=6402
prior-facts=1
mean4954.156-4880.068=74.087
σ0.594-0.599=-0.005
min4953.836-4879.733=74.103
max4955.215-4881.133=74.082
mean2674.000-2632.000=42.000
σ0.000
min2674.000-2632.000=42.000
max2674.000-2632.000=42.000
mean7.947-8.225=-0.278
σ0.239-0.285=-0.046
min7.708-7.776=-0.068
max8.342-8.556=-0.214
iters=5
new-facts=6402
prior-facts=6402
mean5168.826-4891.624=277.202
σ0.092-0.127=-0.035
min5168.722-4891.416=277.305
max5168.908-4891.763=277.144
mean3363.200-3352.600=10.600
σ467.063-465.019=2.045
min2736.000-2780.000=-44.000
max3969.000-4016.000=-47.000
mean9.089-8.269=0.820
σ0.492-0.171=0.321
min8.412-8.034=0.379
max9.562-8.447=1.115

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.091-1.057=0.034
σ0.265-0.127=0.138
min0.933-0.940=-0.006
max1.556-1.246=0.310

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.818-456.475=3.343
σ571.583-572.535=-0.952
min174.017-170.205=3.812
max1317.193-1315.278=1.915
mean79.500
σ7.000
min76.000
max90.000
mean2674.000-434.000=2240.000
σ0.000
min2674.000-434.000=2240.000
max2674.000-434.000=2240.000
mean0.533-0.547=-0.014
σ0.532-0.557=-0.025
min0.263-0.258=0.005
max1.332-1.383=-0.051
policies=20
mean1740.426-1702.579=37.846
σ0.335-0.306=0.029
min1740.217-1702.359=37.859
max1740.926-1703.027=37.899
mean760.000
σ0.000
min760.000
max760.000
mean2674.000-441.000=2233.000
σ0.000-8.083=-8.083
min2674.000-434.000=2240.000
max2674.000-448.000=2226.000
mean2.700-2.620=0.080
σ0.026-0.002=0.024
min2.665-2.616=0.048
max2.728-2.622=0.106
policies=200
mean17411.276-17035.241=376.036
σ0.461-0.071=0.390
min17411.022-17035.175=375.847
max17411.967-17035.336=376.630
mean7600.000
σ0.000
min7600.000
max7600.000
mean2674.000-493.250=2180.750
σ0.000-2.500=-2.500
min2674.000-490.000=2184.000
max2674.000-496.000=2178.000
mean27.096-26.421=0.675
σ0.125-0.108=0.017
min27.001-26.306=0.695
max27.281-26.515=0.766