Compare commits

Home / Compare 2f3c3288 .. 2cd1139e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.780-70.782=-0.001
σ0.052-0.053=-0.001
min70.753-70.752=0.001
max70.926-70.931=-0.005
mean412.000-415.800=-3.800
σ0.000-0.422=-0.422
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.157-0.159=-0.002
σ0.005-0.005=0.000
min0.150-0.151=-0.001
max0.166-0.167=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.494-21.494=-0.000
σ0.003-0.002=0.001
min21.488-21.491=-0.003
max21.498-21.496=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.064-0.065=-0.002
σ0.003-0.003=0.000
min0.060-0.063=-0.003
max0.070-0.073=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.882-1751.881=0.001
σ0.360-0.361=-0.001
min1751.318-1751.315=0.002
max1752.475-1752.470=0.005
mean1640.250-1637.350=2.900
σ630.515-627.904=2.611
min617.000-621.000=-4.000
max2777.000-2772.000=5.000
mean2.840-2.828=0.013
σ0.147-0.190=-0.042
min2.450-2.440=0.010
max3.150-3.160=-0.010

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.381-269.382=-0.001
σ0.008-0.006=0.003
min269.367-269.375=-0.008
max269.387-269.389=-0.002
mean2777.000-2772.000=5.000
σ0.000
min2777.000-2772.000=5.000
max2777.000-2772.000=5.000
mean0.380-0.378=0.002
σ0.008-0.006=0.002
min0.375-0.373=0.002
max0.394-0.386=0.008
iters=5
new-facts=1
prior-facts=6402
mean1929.745-1929.744=0.001
σ0.016-0.014=0.002
min1929.724-1929.719=0.006
max1929.765-1929.757=0.008
mean2777.000-2772.000=5.000
σ0.000
min2777.000-2772.000=5.000
max2777.000-2772.000=5.000
mean2.951-2.995=-0.044
σ0.265-0.047=0.217
min2.488-2.927=-0.439
max3.137-3.050=0.087
iters=5
new-facts=6402
prior-facts=1
mean4750.374-4750.402=-0.028
σ0.948-0.959=-0.011
min4749.619-4749.584=0.036
max4752.028-4752.051=-0.022
mean2777.000-2772.000=5.000
σ0.000
min2777.000-2772.000=5.000
max2777.000-2772.000=5.000
mean8.558-8.534=0.024
σ0.530-0.607=-0.077
min7.817-7.602=0.215
max9.199-9.238=-0.039
iters=5
new-facts=6402
prior-facts=6402
mean4940.914-4940.986=-0.072
σ0.156-0.015=0.141
min4940.637-4940.960=-0.323
max4941.005-4940.998=0.007
mean3021.600-2982.800=38.800
σ289.072-217.906=71.166
min2777.000-2772.000=5.000
max3449.000-3302.000=147.000
mean8.475-8.506=-0.030
σ0.105-0.119=-0.014
min8.412-8.356=0.055
max8.662-8.621=0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.028-1.027=0.001
σ0.134-0.138=-0.005
min0.937-0.935=0.003
max1.246-1.253=-0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.711-462.707=0.004
σ574.964-574.960=0.004
min175.228-175.225=0.002
max1325.157-1325.147=0.010
mean86.250
σ8.500
min82.000
max99.000
mean2777.000-2772.000=5.000
σ0.000
min2777.000-2772.000=5.000
max2777.000-2772.000=5.000
mean0.483-0.494=-0.011
σ0.411-0.428=-0.017
min0.275-0.276=-0.001
max1.099-1.135=-0.036
policies=20
mean1752.520-1752.489=0.031
σ0.360-0.349=0.011
min1752.292-1752.262=0.030
max1753.057-1753.009=0.048
mean820.000
σ0.000
min820.000
max820.000
mean2777.000-2772.000=5.000
σ0.000
min2777.000-2772.000=5.000
max2777.000-2772.000=5.000
mean2.744-2.741=0.004
σ0.012-0.006=0.006
min2.730-2.737=-0.006
max2.758-2.750=0.008
policies=200
mean17532.180-17532.202=-0.022
σ0.561-0.578=-0.017
min17531.872-17531.806=0.066
max17533.021-17533.055=-0.034
mean8200.000
σ0.000
min8200.000
max8200.000
mean2777.000-2772.000=5.000
σ0.000
min2777.000-2772.000=5.000
max2777.000-2772.000=5.000
mean27.574-27.541=0.034
σ0.121-0.100=0.021
min27.456-27.480=-0.023
max27.687-27.690=-0.002