Compare commits

Home / Compare 5c9c5914 .. b448550c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.773=-0.001
σ0.046-0.046=-0.001
min30.748-30.754=-0.005
max30.901-30.905=-0.003
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.072-0.077=-0.005
σ0.008-0.003=0.005
min0.059-0.071=-0.012
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=0.001
σ0.003-0.003=0.000
min21.055-21.054=0.001
max21.064-21.063=0.001
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.063-0.064=-0.001
σ0.004-0.002=0.001
min0.057-0.062=-0.005
max0.071-0.069=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.233-1751.236=-0.002
σ0.366-0.363=0.003
min1750.672-1750.671=0.001
max1751.821-1751.815=0.006
mean1648.150-1651.650=-3.500
σ619.549-645.486=-25.937
min682.000-648.000=34.000
max2643.000-2843.000=-200.000
mean2.798-2.805=-0.006
σ0.190-0.204=-0.014
min2.299-2.361=-0.062
max3.140-3.233=-0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.565=0.001
σ0.004-0.006=-0.002
min275.559-275.559=-0.000
max275.569-275.573=-0.004
mean2643.000-2843.000=-200.000
σ0.000
min2643.000-2843.000=-200.000
max2643.000-2843.000=-200.000
mean0.392-0.387=0.006
σ0.007-0.002=0.005
min0.387-0.384=0.003
max0.401-0.389=0.012
iters=5
new-facts=1
prior-facts=6402
mean2168.102-2168.090=0.012
σ0.009-0.022=-0.013
min2168.089-2168.059=0.030
max2168.114-2168.117=-0.003
mean2643.000-2843.000=-200.000
σ0.000
min2643.000-2843.000=-200.000
max2643.000-2843.000=-200.000
mean2.830-2.844=-0.013
σ0.119-0.129=-0.010
min2.680-2.673=0.007
max2.969-2.995=-0.026
iters=5
new-facts=6402
prior-facts=1
mean5047.894-5047.949=-0.056
σ0.908-0.923=-0.015
min5047.374-5047.372=0.002
max5049.507-5049.590=-0.083
mean2643.000-2843.000=-200.000
σ0.000
min2643.000-2843.000=-200.000
max2643.000-2843.000=-200.000
mean8.850-8.872=-0.023
σ0.452-0.641=-0.189
min8.084-8.091=-0.007
max9.284-9.533=-0.249
iters=5
new-facts=6402
prior-facts=6402
mean5179.027-5179.048=-0.021
σ0.087-0.095=-0.008
min5178.942-5178.958=-0.016
max5179.123-5179.154=-0.030
mean3207.600-3283.000=-75.400
σ485.494-392.859=92.634
min2643.000-2843.000=-200.000
max3864.000-3848.000=16.000
mean9.609-9.712=-0.104
σ0.610-0.588=0.023
min8.635-8.795=-0.160
max10.197-10.177=0.020

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.182-1.098=0.085
σ0.270-0.217=0.053
min0.959-0.972=-0.013
max1.606-1.475=0.132

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.203=0.001
σ572.663-572.650=0.012
min176.869-176.870=-0.001
max1322.197-1322.178=0.020
mean77.500
σ7.000
min74.000
max88.000
mean2643.000-2843.000=-200.000
σ0.000
min2643.000-2843.000=-200.000
max2643.000-2843.000=-200.000
mean0.560-0.439=0.121
σ0.564-0.313=0.251
min0.277-0.275=0.002
max1.405-0.908=0.497
policies=20
mean1768.973-1768.973=-0.000
σ0.340-0.346=-0.006
min1768.759-1768.734=0.025
max1769.480-1769.484=-0.003
mean740.000
σ0.000
min740.000
max740.000
mean2643.000-2843.000=-200.000
σ0.000
min2643.000-2843.000=-200.000
max2643.000-2843.000=-200.000
mean2.745-2.850=-0.105
σ0.030-0.017=0.012
min2.712-2.829=-0.116
max2.772-2.871=-0.099
policies=200
mean17696.254-17696.042=0.211
σ0.470-0.488=-0.018
min17696.014-17695.732=0.283
max17696.958-17696.765=0.193
mean7400.000
σ0.000
min7400.000
max7400.000
mean2643.000-2843.000=-200.000
σ0.000
min2643.000-2843.000=-200.000
max2643.000-2843.000=-200.000
mean27.667-28.156=-0.488
σ0.136-0.531=-0.395
min27.517-27.502=0.015
max27.836-28.646=-0.810