Compare commits

Home / Compare c41a3920 .. af6ad537

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.040=-0.000
σ0.051-0.047=0.004
min31.001-31.001=0.000
max31.183-31.171=0.013
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.077-0.077=-0.000
σ0.005-0.004=0.001
min0.072-0.071=0.000
max0.087-0.085=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.004=-0.001
min21.141-21.137=0.004
max21.147-21.147=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.057=0.005
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.413=-0.002
σ0.361-0.361=0.000
min1750.844-1750.848=-0.004
max1752.006-1751.998=0.008
mean1652.200-1660.500=-8.300
σ622.833-633.821=-10.988
min682.000-624.000=58.000
max2650.000-2774.000=-124.000
mean2.870-2.875=-0.005
σ0.126-0.117=0.009
min2.622-2.628=-0.006
max3.042-3.138=-0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.779-266.787=-0.009
σ0.007-0.010=-0.003
min266.768-266.778=-0.010
max266.786-266.799=-0.013
mean2650.000-2774.000=-124.000
σ0.000
min2650.000-2774.000=-124.000
max2650.000-2774.000=-124.000
mean0.365-0.365=0.000
σ0.001-0.001=0.000
min0.364-0.363=0.001
max0.367-0.366=0.001
iters=5
new-facts=1
prior-facts=6402
mean1927.207-1927.216=-0.009
σ0.009-0.009=0.000
min1927.195-1927.206=-0.011
max1927.221-1927.228=-0.007
mean2650.000-2774.000=-124.000
σ0.000
min2650.000-2774.000=-124.000
max2650.000-2774.000=-124.000
mean3.069-2.977=0.092
σ0.078-0.095=-0.017
min2.999-2.866=0.133
max3.177-3.118=0.058
iters=5
new-facts=6402
prior-facts=1
mean4747.749-4747.730=0.019
σ0.776-0.803=-0.027
min4747.289-4747.295=-0.006
max4749.126-4749.162=-0.036
mean2650.000-2774.000=-124.000
σ0.000
min2650.000-2774.000=-124.000
max2650.000-2774.000=-124.000
mean8.194-8.298=-0.104
σ0.373-0.698=-0.325
min7.851-7.682=0.168
max8.773-9.191=-0.418
iters=5
new-facts=6402
prior-facts=6402
mean4938.164-4938.168=-0.003
σ0.089-0.079=0.010
min4938.072-4938.105=-0.033
max4938.272-4938.266=0.006
mean2972.600-3038.400=-65.800
σ344.106-313.774=30.332
min2650.000-2774.000=-124.000
max3433.000-3501.000=-68.000
mean8.486-8.387=0.099
σ0.217-0.124=0.092
min8.266-8.259=0.008
max8.820-8.595=0.226

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.073-1.034=0.038
σ0.191-0.140=0.051
min0.937-0.939=-0.002
max1.343-1.259=0.083

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.124-465.120=0.004
σ575.764-575.757=0.007
min177.233-177.236=-0.002
max1328.770-1328.756=0.014
mean79.750
σ7.500
min76.000
max91.000
mean2650.000-2774.000=-124.000
σ0.000
min2650.000-2774.000=-124.000
max2650.000-2774.000=-124.000
mean0.575-0.446=0.129
σ0.592-0.307=0.285
min0.277-0.291=-0.014
max1.464-0.907=0.557
policies=20
mean1772.590-1772.645=-0.055
σ0.329-0.339=-0.010
min1772.365-1772.395=-0.030
max1773.078-1773.139=-0.061
mean760.000
σ0.000
min760.000
max760.000
mean2650.000-2774.000=-124.000
σ0.000
min2650.000-2774.000=-124.000
max2650.000-2774.000=-124.000
mean2.757-2.829=-0.071
σ0.017-0.102=-0.084
min2.738-2.752=-0.013
max2.780-2.974=-0.194
policies=200
mean17732.490-17732.346=0.144
σ0.411-0.602=-0.191
min17732.260-17732.009=0.251
max17733.106-17733.249=-0.143
mean7600.000
σ0.000
min7600.000
max7600.000
mean2650.000-2774.000=-124.000
σ0.000
min2650.000-2774.000=-124.000
max2650.000-2774.000=-124.000
mean27.788-27.760=0.028
σ0.132-0.215=-0.083
min27.690-27.502=0.189
max27.981-27.988=-0.007