Compare commits

Home / Compare 4b7d3d55 .. dc400bc9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.729=0.051
σ0.046-0.048=-0.002
min70.751-70.701=0.050
max70.909-70.863=0.046
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.158-0.159=-0.001
σ0.003-0.004=-0.001
min0.152-0.152=-0.000
max0.162-0.165=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.493-21.447=0.046
σ0.002-0.003=-0.001
min21.490-21.442=0.047
max21.496-21.451=0.045
mean413.000
σ0.000
min413.000
max413.000
mean0.063-0.066=-0.003
σ0.004-0.002=0.001
min0.059-0.064=-0.005
max0.068-0.072=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.092-1754.527=-0.436
σ0.361-0.363=-0.002
min1753.524-1753.954=-0.429
max1754.676-1755.127=-0.451
mean1669.050-1639.450=29.600
σ645.386-626.862=18.523
min665.000-622.000=43.000
max2655.000-2840.000=-185.000
mean2.845-2.730=0.115
σ0.131-0.207=-0.077
min2.528-2.244=0.285
max3.135-2.962=0.172

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-273.609=-1.653
σ0.009-0.006=0.003
min271.942-273.602=-1.659
max271.964-273.614=-1.650
mean2655.000-2840.000=-185.000
σ0.000
min2655.000-2840.000=-185.000
max2655.000-2840.000=-185.000
mean0.383-0.387=-0.004
σ0.007-0.005=0.002
min0.379-0.382=-0.003
max0.396-0.395=0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.322-1934.002=-1.680
σ0.006-0.007=-0.001
min1932.313-1933.995=-1.681
max1932.328-1934.010=-1.681
mean2655.000-2840.000=-185.000
σ0.000
min2655.000-2840.000=-185.000
max2655.000-2840.000=-185.000
mean2.933-2.996=-0.064
σ0.309-0.158=0.151
min2.391-2.741=-0.350
max3.145-3.142=0.003
iters=5
new-facts=6402
prior-facts=1
mean4753.127-4754.773=-1.646
σ0.839-0.839=-0.000
min4752.588-4754.246=-1.658
max4754.613-4756.264=-1.651
mean2655.000-2840.000=-185.000
σ0.000
min2655.000-2840.000=-185.000
max2655.000-2840.000=-185.000
mean8.287-8.498=-0.211
σ0.526-0.529=-0.003
min7.581-7.625=-0.044
max8.971-9.049=-0.078
iters=5
new-facts=6402
prior-facts=6402
mean4943.488-4945.158=-1.670
σ0.146-0.166=-0.020
min4943.228-4944.864=-1.636
max4943.574-4945.263=-1.689
mean3019.200-3050.000=-30.800
σ273.507-195.032=78.475
min2655.000-2840.000=-185.000
max3339.000-3330.000=9.000
mean8.556-8.802=-0.246
σ0.146-0.301=-0.155
min8.391-8.510=-0.119
max8.713-9.305=-0.592

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.222-1.008=0.214
σ0.271-0.127=0.144
min0.924-0.926=-0.001
max1.646-1.215=0.431

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.657-472.845=-4.188
σ574.936-574.926=0.010
min181.187-185.376=-4.189
max1331.061-1335.234=-4.173
mean88.250
σ8.500
min84.000
max101.000
mean2655.000-2840.000=-185.000
σ0.000
min2655.000-2840.000=-185.000
max2655.000-2840.000=-185.000
mean0.560-0.488=0.072
σ0.556-0.375=0.181
min0.275-0.298=-0.023
max1.394-1.050=0.344
policies=20
mean1812.203-1854.032=-41.830
σ0.375-0.360=0.015
min1811.953-1853.778=-41.825
max1812.757-1854.559=-41.802
mean840.000
σ0.000
min840.000
max840.000
mean2655.000-2840.000=-185.000
σ0.000
min2655.000-2840.000=-185.000
max2655.000-2840.000=-185.000
mean2.848-2.962=-0.114
σ0.029-0.004=0.024
min2.818-2.957=-0.138
max2.884-2.967=-0.082
policies=200
mean18129.230-18546.633=-417.403
σ0.433-0.406=0.027
min18128.917-18546.277=-417.360
max18129.868-18547.203=-417.335
mean8400.000
σ0.000
min8400.000
max8400.000
mean2655.000-2840.000=-185.000
σ0.000
min2655.000-2840.000=-185.000
max2655.000-2840.000=-185.000
mean28.631-29.140=-0.510
σ0.109-0.566=-0.457
min28.496-28.790=-0.294
max28.740-29.986=-1.245