Compare commits

Home / Compare d8d65c03 .. df0441b1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.780=0.001
σ0.055-0.051=0.004
min70.746-70.746=-0.000
max70.935-70.921=0.013
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.159-0.157=0.002
σ0.004-0.005=-0.001
min0.151-0.151=0.000
max0.165-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.000
σ0.003-0.003=-0.001
min21.489-21.489=0.000
max21.497-21.500=-0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.064-0.065=-0.001
σ0.002-0.003=-0.001
min0.060-0.064=-0.004
max0.067-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.880-1751.881=-0.001
σ0.360-0.362=-0.001
min1751.314-1751.307=0.006
max1752.470-1752.462=0.008
mean1663.400-1656.050=7.350
σ625.968-627.736=-1.768
min649.000-679.000=-30.000
max2503.000-2663.000=-160.000
mean2.787-2.832=-0.045
σ0.200-0.161=0.038
min2.146-2.471=-0.325
max3.160-3.066=0.094

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.377-269.375=0.002
σ0.003-0.004=-0.001
min269.373-269.370=0.003
max269.380-269.380=0.001
mean2503.000-2663.000=-160.000
σ0.000
min2503.000-2663.000=-160.000
max2503.000-2663.000=-160.000
mean0.378-0.377=0.002
σ0.004-0.003=0.000
min0.374-0.374=0.000
max0.383-0.382=0.001
iters=5
new-facts=1
prior-facts=6402
mean1929.743-1929.746=-0.002
σ0.017-0.015=0.003
min1929.724-1929.726=-0.001
max1929.769-1929.763=0.006
mean2503.000-2663.000=-160.000
σ0.000
min2503.000-2663.000=-160.000
max2503.000-2663.000=-160.000
mean3.011-3.023=-0.012
σ0.047-0.068=-0.020
min2.979-2.955=0.024
max3.094-3.136=-0.042
iters=5
new-facts=6402
prior-facts=1
mean4750.525-4750.517=0.008
σ0.873-0.850=0.024
min4750.058-4750.056=0.003
max4752.080-4752.030=0.051
mean2503.000-2663.000=-160.000
σ0.000
min2503.000-2663.000=-160.000
max2503.000-2663.000=-160.000
mean8.425-8.415=0.009
σ0.480-0.461=0.019
min7.634-7.627=0.007
max8.874-8.814=0.060
iters=5
new-facts=6402
prior-facts=6402
mean4940.986-4940.984=0.002
σ0.013-0.015=-0.001
min4940.969-4940.967=0.002
max4940.997-4941.002=-0.005
mean2961.000-2959.800=1.200
σ315.448-328.062=-12.614
min2503.000-2663.000=-160.000
max3348.000-3428.000=-80.000
mean8.499-8.364=0.135
σ0.106-0.046=0.060
min8.405-8.293=0.113
max8.668-8.418=0.250

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.688-1.143=0.545
σ0.262-0.197=0.065
min1.248-0.935=0.313
max1.876-1.448=0.428

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.056-466.066=-0.010
σ574.928-574.949=-0.021
min178.590-178.590=0.000
max1328.447-1328.489=-0.042
mean86.250
σ8.500
min82.000
max99.000
mean2503.000-2663.000=-160.000
σ0.000
min2503.000-2663.000=-160.000
max2503.000-2663.000=-160.000
mean0.563-0.564=-0.001
σ0.558-0.558=0.001
min0.279-0.281=-0.002
max1.400-1.400=0.000
policies=20
mean1786.154-1786.123=0.030
σ0.367-0.346=0.021
min1785.929-1785.919=0.010
max1786.702-1786.641=0.061
mean820.000
σ0.000
min820.000
max820.000
mean2503.000-2663.000=-160.000
σ0.000
min2503.000-2663.000=-160.000
max2503.000-2663.000=-160.000
mean2.777-2.769=0.008
σ0.006-0.017=-0.011
min2.772-2.751=0.022
max2.784-2.791=-0.006
policies=200
mean17868.477-17868.386=0.091
σ0.603-0.576=0.027
min17868.150-17867.950=0.200
max17869.380-17869.217=0.164
mean8200.000
σ0.000
min8200.000
max8200.000
mean2503.000-2663.000=-160.000
σ0.000
min2503.000-2663.000=-160.000
max2503.000-2663.000=-160.000
mean27.895-27.869=0.026
σ0.065-0.026=0.039
min27.817-27.848=-0.030
max27.974-27.907=0.067