Compare commits

Home / Compare 3d74ff76 .. 86fad8fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=0.001
σ0.048-0.049=-0.001
min30.729-30.730=-0.001
max30.903-30.905=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.078-0.079=-0.001
σ0.003-0.003=-0.000
min0.076-0.077=-0.001
max0.085-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=-0.000
σ0.004-0.002=0.001
min21.056-21.056=-0.001
max21.066-21.064=0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.063-0.064=-0.001
σ0.002-0.002=0.000
min0.062-0.063=-0.001
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.419-1751.418=0.001
σ0.361-0.363=-0.002
min1750.850-1750.856=-0.006
max1752.005-1751.998=0.008
mean1648.650-1647.900=0.750
σ622.103-622.240=-0.137
min679.000-680.000=-1.000
max2647.000-2646.000=1.000
mean2.827-2.812=0.015
σ0.226-0.189=0.037
min2.165-2.364=-0.200
max3.329-3.175=0.154

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.753-275.755=-0.003
σ0.010-0.006=0.004
min275.742-275.749=-0.007
max275.765-275.765=0.000
mean2647.000-2646.000=1.000
σ0.000
min2647.000-2646.000=1.000
max2647.000-2646.000=1.000
mean0.395-0.401=-0.006
σ0.009-0.016=-0.007
min0.387-0.384=0.002
max0.407-0.423=-0.015
iters=5
new-facts=1
prior-facts=6402
mean2168.280-2168.282=-0.002
σ0.005-0.016=-0.010
min2168.272-2168.259=0.013
max2168.286-2168.297=-0.012
mean2647.000-2646.000=1.000
σ0.000
min2647.000-2646.000=1.000
max2647.000-2646.000=1.000
mean2.909-2.957=-0.048
σ0.166-0.157=0.009
min2.701-2.756=-0.055
max3.056-3.146=-0.091
iters=5
new-facts=6402
prior-facts=1
mean5048.117-5047.990=0.127
σ0.939-0.649=0.290
min5047.558-5047.575=-0.016
max5049.789-5049.136=0.653
mean2647.000-2646.000=1.000
σ0.000
min2647.000-2646.000=1.000
max2647.000-2646.000=1.000
mean8.858-8.655=0.202
σ0.526-0.365=0.160
min8.086-8.155=-0.069
max9.364-9.087=0.278
iters=5
new-facts=6402
prior-facts=6402
mean5179.239-5179.240=-0.001
σ0.081-0.079=0.002
min5179.162-5179.169=-0.007
max5179.341-5179.336=0.005
mean3225.400-3266.800=-41.400
σ389.844-378.852=10.991
min2699.000-2732.000=-33.000
max3733.000-3724.000=9.000
mean9.920-9.879=0.041
σ0.361-0.323=0.038
min9.468-9.429=0.038
max10.309-10.139=0.170

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.172-1.260=-0.088
σ0.367-0.312=0.055
min0.932-1.078=-0.146
max1.787-1.800=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.575-463.575=0.001
σ572.670-572.664=0.007
min177.237-177.240=-0.003
max1322.581-1322.570=0.011
mean79.750
σ7.500
min76.000
max91.000
mean2647.000-2646.000=1.000
σ0.000
min2647.000-2646.000=1.000
max2647.000-2646.000=1.000
mean0.560-0.541=0.019
σ0.558-0.529=0.029
min0.274-0.273=0.001
max1.397-1.334=0.063
policies=20
mean1772.628-1772.637=-0.009
σ0.311-0.329=-0.019
min1772.431-1772.415=0.017
max1773.092-1773.125=-0.033
mean760.000
σ0.000
min760.000
max760.000
mean2647.000-2646.000=1.000
σ0.000
min2647.000-2646.000=1.000
max2647.000-2646.000=1.000
mean2.739-2.733=0.006
σ0.017-0.011=0.006
min2.721-2.723=-0.002
max2.757-2.745=0.012
policies=200
mean17732.933-17732.975=-0.042
σ0.588-0.382=0.206
min17732.543-17732.725=-0.182
max17733.803-17733.538=0.266
mean7600.000
σ0.000
min7600.000
max7600.000
mean2647.000-2646.000=1.000
σ0.000
min2647.000-2646.000=1.000
max2647.000-2646.000=1.000
mean27.720-27.644=0.076
σ0.136-0.130=0.007
min27.551-27.521=0.029
max27.861-27.827=0.034