Compare commits

Home / Compare 2087b877 .. fbe37931

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.782=-0.001
σ0.047-0.048=-0.002
min70.748-70.747=0.001
max70.909-70.914=-0.005
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.158-0.156=0.001
σ0.003-0.005=-0.002
min0.156-0.150=0.005
max0.164-0.163=0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=-0.000
σ0.002-0.003=-0.001
min21.488-21.486=0.003
max21.495-21.496=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.066-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.063=0.000
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1716.185=37.910
σ0.361-169.643=-169.281
min1753.529-995.455=758.074
max1754.682-1754.689=-0.008
mean1658.850-1613.550=45.300
σ617.733-625.227=-7.495
min638.000-648.000=-10.000
max2495.000-2474.000=21.000
mean2.827-2.750=0.078
σ0.186-0.339=-0.152
min2.321-1.593=0.728
max3.179-3.205=-0.026

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.599-271.597=0.002
σ0.008-0.006=0.002
min271.590-271.591=-0.001
max271.608-271.607=0.001
mean2495.000-2474.000=21.000
σ0.000
min2495.000-2474.000=21.000
max2495.000-2474.000=21.000
mean0.382-0.383=-0.001
σ0.005-0.004=0.001
min0.379-0.381=-0.002
max0.390-0.389=0.000
iters=5
new-facts=1
prior-facts=6402
mean1931.990-1931.999=-0.009
σ0.018-0.019=-0.001
min1931.962-1931.978=-0.016
max1932.004-1932.019=-0.015
mean2495.000-2474.000=21.000
σ0.000
min2495.000-2474.000=21.000
max2495.000-2474.000=21.000
mean2.589-2.495=0.094
σ0.087-0.097=-0.010
min2.499-2.398=0.101
max2.680-2.632=0.049
iters=5
new-facts=6402
prior-facts=1
mean4752.812-4752.670=0.143
σ0.807-0.954=-0.147
min4752.360-4751.703=0.657
max4754.253-4754.269=-0.015
mean2495.000-2474.000=21.000
σ0.000
min2495.000-2474.000=21.000
max2495.000-2474.000=21.000
mean7.961-8.374=-0.414
σ0.283-0.485=-0.202
min7.768-7.730=0.038
max8.463-8.880=-0.418
iters=5
new-facts=6402
prior-facts=6402
mean4943.206-4943.202=0.004
σ0.022-0.010=0.012
min4943.181-4943.188=-0.006
max4943.230-4943.214=0.016
mean2950.600-2999.000=-48.400
σ370.370-286.083=84.287
min2495.000-2608.000=-113.000
max3437.000-3324.000=113.000
mean8.424-8.516=-0.092
σ0.104-0.097=0.007
min8.342-8.413=-0.071
max8.602-8.619=-0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.778-1.774=0.004
σ0.062-0.231=-0.169
min1.719-1.376=0.343
max1.864-1.938=-0.073

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.609-468.607=0.002
σ574.878-574.883=-0.005
min181.166-181.159=0.007
max1330.927-1330.932=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2495.000-2474.000=21.000
σ0.000
min2495.000-2474.000=21.000
max2495.000-2474.000=21.000
mean0.559-0.558=0.001
σ0.544-0.537=0.007
min0.285-0.286=-0.002
max1.375-1.363=0.012
policies=20
mean1811.959-1811.965=-0.006
σ0.387-0.390=-0.003
min1811.703-1811.705=-0.002
max1812.531-1812.539=-0.008
mean840.000
σ0.000
min840.000
max840.000
mean2495.000-2474.000=21.000
σ0.000
min2495.000-2474.000=21.000
max2495.000-2474.000=21.000
mean2.844-2.850=-0.006
σ0.019-0.006=0.013
min2.821-2.845=-0.024
max2.867-2.857=0.010
policies=200
mean18126.684-18126.614=0.070
σ0.357-0.553=-0.197
min18126.433-18126.150=0.284
max18127.212-18127.393=-0.181
mean8400.000
σ0.000
min8400.000
max8400.000
mean2495.000-2474.000=21.000
σ0.000
min2495.000-2474.000=21.000
max2495.000-2474.000=21.000
mean28.652-28.580=0.073
σ0.052-0.147=-0.095
min28.585-28.480=0.105
max28.708-28.798=-0.091