Compare commits

Home / Compare 1b83aea4 .. a2ae6abd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-70.374=0.001
σ0.059-0.058=0.001
min70.330-70.331=-0.001
max70.540-70.537=0.003
mean412.000
σ0.000
min412.000
max412.000
mean0.158-0.158=0.000
σ0.005-0.004=0.001
min0.151-0.154=-0.004
max0.165-0.164=0.001
cache=y
dps=1
iters=10
policies=100
mean21.144-21.143=0.000
σ0.002-0.001=0.001
min21.141-21.141=0.000
max21.147-21.145=0.001
mean412.000
σ0.000
min412.000
max412.000
mean0.064-0.064=0.000
σ0.002-0.002=-0.000
min0.063-0.063=0.000
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.200=0.000
σ0.360-0.362=-0.002
min1751.628-1751.626=0.002
max1752.776-1752.784=-0.008
mean1656.650-1648.600=8.050
σ645.371-642.098=3.272
min628.000-630.000=-2.000
max2860.000-2843.000=17.000
mean2.797-2.781=0.016
σ0.152-0.147=0.005
min2.516-2.340=0.177
max2.958-2.994=-0.036

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.930-269.934=-0.004
σ0.011-0.011=0.000
min269.917-269.917=-0.000
max269.943-269.945=-0.002
mean2860.000-2843.000=17.000
σ0.000
min2860.000-2843.000=17.000
max2860.000-2843.000=17.000
mean0.374-0.383=-0.009
σ0.008-0.006=0.002
min0.369-0.376=-0.007
max0.388-0.391=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.389-1930.403=-0.015
σ0.025-0.013=0.013
min1930.359-1930.387=-0.028
max1930.414-1930.417=-0.003
mean2860.000-2843.000=17.000
σ0.000
min2860.000-2843.000=17.000
max2860.000-2843.000=17.000
mean2.563-2.503=0.060
σ0.150-0.112=0.038
min2.458-2.405=0.053
max2.828-2.682=0.146
iters=5
new-facts=6402
prior-facts=1
mean4750.884-4750.870=0.014
σ0.779-0.798=-0.018
min4750.403-4750.314=0.089
max4752.266-4752.272=-0.006
mean2860.000-2843.000=17.000
σ0.000
min2860.000-2843.000=17.000
max2860.000-2843.000=17.000
mean8.428-8.414=0.013
σ0.169-0.629=-0.460
min8.226-7.568=0.657
max8.615-9.124=-0.509
iters=5
new-facts=6402
prior-facts=6402
mean4941.261-4941.336=-0.075
σ0.207-0.085=0.122
min4940.922-4941.268=-0.346
max4941.437-4941.430=0.007
mean3051.000-3093.800=-42.800
σ195.574-252.406=-56.832
min2860.000-2843.000=17.000
max3323.000-3352.000=-29.000
mean8.504-8.656=-0.152
σ0.110-0.256=-0.147
min8.361-8.334=0.027
max8.605-8.971=-0.367

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.019-1.052=-0.033
σ0.123-0.128=-0.005
min0.932-0.936=-0.004
max1.216-1.250=-0.034

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.910=0.000
σ575.755-575.755=-0.001
min178.028-178.030=-0.002
max1329.543-1329.544=-0.001
mean81.750
σ7.500
min78.000
max93.000
mean2860.000-2843.000=17.000
σ0.000
min2860.000-2843.000=17.000
max2860.000-2843.000=17.000
mean0.442-0.440=0.002
σ0.305-0.307=-0.002
min0.283-0.284=-0.000
max0.899-0.900=-0.001
policies=20
mean1780.492-1780.497=-0.004
σ0.351-0.334=0.017
min1780.247-1780.248=-0.000
max1781.009-1780.985=0.024
mean780.000
σ0.000
min780.000
max780.000
mean2860.000-2843.000=17.000
σ0.000
min2860.000-2843.000=17.000
max2860.000-2843.000=17.000
mean2.846-2.831=0.014
σ0.010-0.012=-0.003
min2.833-2.813=0.019
max2.855-2.841=0.014
policies=200
mean17811.350-17811.318=0.032
σ0.536-0.456=0.080
min17810.970-17810.990=-0.019
max17812.145-17811.993=0.152
mean7800.000
σ0.000
min7800.000
max7800.000
mean2860.000-2843.000=17.000
σ0.000
min2860.000-2843.000=17.000
max2860.000-2843.000=17.000
mean28.305-28.267=0.037
σ0.467-0.419=0.048
min27.762-27.774=-0.012
max28.780-28.656=0.125