Compare commits

Home / Compare 30fedeb8 .. dd9c237c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.960-30.773=0.187
σ0.047-0.046=0.001
min30.923-30.748=0.175
max31.089-30.903=0.186
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.077-0.078=-0.001
σ0.003-0.005=-0.001
min0.074-0.072=0.001
max0.083-0.085=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.061-21.060=0.001
σ0.003-0.002=0.001
min21.056-21.055=0.001
max21.066-21.063=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.063-0.066=-0.003
σ0.003-0.004=-0.001
min0.061-0.063=-0.002
max0.071-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.237=0.173
σ0.359-0.365=-0.005
min1750.847-1750.665=0.182
max1751.980-1751.824=0.155
mean1663.600-1669.550=-5.950
σ623.503-639.584=-16.081
min640.000-683.000=-43.000
max2512.000-2699.000=-187.000
mean2.740-2.802=-0.061
σ0.260-0.209=0.052
min2.162-2.263=-0.101
max3.187-3.345=-0.158

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.404-273.202=0.202
σ0.010-0.003=0.007
min273.394-273.200=0.194
max273.415-273.207=0.208
mean2512.000-2699.000=-187.000
σ0.000
min2512.000-2699.000=-187.000
max2512.000-2699.000=-187.000
mean0.393-0.404=-0.011
σ0.003-0.009=-0.006
min0.390-0.390=-0.000
max0.398-0.414=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.840-1933.636=0.205
σ0.020-0.012=0.008
min1933.814-1933.618=0.196
max1933.864-1933.645=0.219
mean2512.000-2699.000=-187.000
σ0.000
min2512.000-2699.000=-187.000
max2512.000-2699.000=-187.000
mean2.959-3.035=-0.077
σ0.207-0.163=0.044
min2.685-2.770=-0.084
max3.167-3.207=-0.040
iters=5
new-facts=6402
prior-facts=1
mean4754.387-4754.171=0.216
σ0.769-0.900=-0.131
min4753.983-4753.634=0.349
max4755.759-4755.768=-0.009
mean2512.000-2699.000=-187.000
σ0.000
min2512.000-2699.000=-187.000
max2512.000-2699.000=-187.000
mean8.033-8.235=-0.202
σ0.494-0.679=-0.185
min7.656-7.664=-0.008
max8.799-9.217=-0.418
iters=5
new-facts=6402
prior-facts=6402
mean4764.740-4944.378=-179.638
σ402.452-0.224=402.228
min4044.813-4944.169=-899.356
max4944.882-4944.684=0.198
mean2949.000-3013.400=-64.400
σ416.413-359.261=57.152
min2512.000-2699.000=-187.000
max3527.000-3533.000=-6.000
mean8.171-8.369=-0.198
σ0.461-0.104=0.357
min7.354-8.306=-0.952
max8.483-8.553=-0.071

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.642-1.116=0.526
σ0.171-0.173=-0.003
min1.438-0.949=0.489
max1.806-1.326=0.480

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.205=0.129
σ572.196-572.658=-0.462
min177.232-176.871=0.361
max1321.627-1322.192=-0.565
mean79.750-77.500=2.250
σ7.500-7.000=0.500
min76.000-74.000=2.000
max91.000-88.000=3.000
mean2512.000-2699.000=-187.000
σ0.000
min2512.000-2699.000=-187.000
max2512.000-2699.000=-187.000
mean0.547-0.520=0.027
σ0.534-0.489=0.045
min0.277-0.273=0.003
max1.347-1.253=0.094
policies=20
mean1772.591-1768.965=3.626
σ0.337-0.334=0.003
min1772.373-1768.746=3.627
max1773.092-1769.463=3.629
mean760.000-740.000=20.000
σ0.000
min760.000-740.000=20.000
max760.000-740.000=20.000
mean2512.000-2699.000=-187.000
σ0.000
min2512.000-2699.000=-187.000
max2512.000-2699.000=-187.000
mean2.748-2.756=-0.009
σ0.017-0.025=-0.008
min2.730-2.736=-0.006
max2.768-2.790=-0.022
policies=200
mean17732.416-17696.144=36.272
σ0.620-0.622=-0.003
min17732.006-17695.716=36.290
max17733.332-17697.065=36.267
mean7600.000-7400.000=200.000
σ0.000
min7600.000-7400.000=200.000
max7600.000-7400.000=200.000
mean2512.000-2699.000=-187.000
σ0.000
min2512.000-2699.000=-187.000
max2512.000-2699.000=-187.000
mean27.763-27.637=0.125
σ0.174-0.199=-0.026
min27.660-27.469=0.191
max28.022-27.873=0.149