Compare commits

Home / Compare 89696a78 .. 52bae79f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.264=-0.001
σ0.054-0.053=0.001
min35.236-35.239=-0.003
max35.415-35.415=-0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.084-0.084=0.000
σ0.003-0.004=-0.001
min0.082-0.078=0.004
max0.090-0.092=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.000
σ0.002-0.003=-0.001
min23.767-23.765=0.001
max23.773-23.774=-0.002
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.068-0.067=0.001
σ0.003-0.003=-0.000
min0.066-0.061=0.005
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.364-0.366=-0.002
min1755.911-1755.909=0.002
max1757.074-1757.077=-0.003
mean1651.250-1654.100=-2.850
σ640.483-643.076=-2.593
min628.000-629.000=-1.000
max2828.000-2838.000=-10.000
mean2.348-2.361=-0.012
σ0.076-0.070=0.007
min2.282-2.261=0.021
max2.570-2.503=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-324.706=0.005
σ0.034-0.056=-0.023
min324.653-324.606=0.048
max324.741-324.737=0.003
mean2828.000-2838.000=-10.000
σ0.000
min2828.000-2838.000=-10.000
max2828.000-2838.000=-10.000
mean0.425-0.427=-0.002
σ0.001-0.002=-0.001
min0.424-0.424=0.000
max0.427-0.429=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.261-1985.254=0.007
σ0.015-0.017=-0.002
min1985.243-1985.229=0.014
max1985.279-1985.276=0.003
mean2828.000-2838.000=-10.000
σ0.000
min2828.000-2838.000=-10.000
max2828.000-2838.000=-10.000
mean2.595-2.712=-0.117
σ0.058-0.129=-0.071
min2.540-2.566=-0.027
max2.667-2.854=-0.187
iters=5
new-facts=6402
prior-facts=1
mean4808.663-4808.668=-0.006
σ7.775-7.820=-0.045
min4804.843-4804.240=0.603
max4822.560-4822.622=-0.062
mean2828.000-2838.000=-10.000
σ0.000
min2828.000-2838.000=-10.000
max2828.000-2838.000=-10.000
mean8.570-8.534=0.036
σ0.319-0.666=-0.347
min8.041-7.737=0.303
max8.887-9.089=-0.203
iters=5
new-facts=6402
prior-facts=6402
mean4996.470-4996.470=-0.000
σ0.020-0.015=0.005
min4996.444-4996.453=-0.009
max4996.492-4996.492=-0.000
mean3065.600-3055.200=10.400
σ230.240-248.756=-18.517
min2828.000-2838.000=-10.000
max3406.000-3431.000=-25.000
mean8.703-8.540=0.162
σ0.208-0.176=0.033
min8.506-8.409=0.096
max8.977-8.843=0.134

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.918-0.945=-0.027
σ0.008-0.045=-0.036
min0.913-0.918=-0.005
max0.933-1.023=-0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.967-462.965=0.002
σ574.248-574.250=-0.001
min175.838-175.835=0.003
max1324.339-1324.339=0.000
mean86.250
σ8.500
min82.000
max99.000
mean2828.000-2838.000=-10.000
σ0.000
min2828.000-2838.000=-10.000
max2828.000-2838.000=-10.000
mean0.431-0.434=-0.003
σ0.302-0.300=0.002
min0.277-0.279=-0.002
max0.884-0.884=-0.001
policies=20
mean1758.703-1758.727=-0.024
σ0.339-0.344=-0.005
min1758.490-1758.491=-0.002
max1759.207-1759.236=-0.029
mean820.000
σ0.000
min820.000
max820.000
mean2828.000-2838.000=-10.000
σ0.000
min2828.000-2838.000=-10.000
max2828.000-2838.000=-10.000
mean2.802-2.802=-0.000
σ0.005-0.010=-0.005
min2.796-2.789=0.007
max2.808-2.812=-0.004
policies=200
mean17593.204-17593.387=-0.183
σ0.736-0.652=0.084
min17592.269-17592.506=-0.236
max17593.912-17593.912=0.000
mean8200.000
σ0.000
min8200.000
max8200.000
mean2828.000-2838.000=-10.000
σ0.000
min2828.000-2838.000=-10.000
max2828.000-2838.000=-10.000
mean27.851-27.953=-0.102
σ0.405-0.383=0.022
min27.501-27.543=-0.042
max28.363-28.355=0.008