Compare commits

Home / Compare c4d77db1 .. 057398e6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.567=-0.001
σ0.046-0.045=0.001
min70.540-70.542=-0.003
max70.691-70.690=0.000
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.161-0.159=0.003
σ0.003-0.004=-0.002
min0.159-0.150=0.009
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=-0.001
σ0.003-0.003=-0.000
min21.283-21.281=0.002
max21.291-21.291=-0.000
mean413.800-412.000=1.800
σ0.422-0.000=0.422
min413.000-412.000=1.000
max414.000-412.000=2.000
mean0.064-0.063=0.002
σ0.001-0.004=-0.003
min0.063-0.058=0.005
max0.066-0.069=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.374-1753.374=0.000
σ0.360-0.362=-0.002
min1752.805-1752.800=0.005
max1753.977-1753.957=0.020
mean1659.750-1650.900=8.850
σ638.154-646.390=-8.236
min617.000-633.000=-16.000
max2813.000-2897.000=-84.000
mean2.791-2.792=-0.000
σ0.132-0.169=-0.037
min2.457-2.289=0.167
max3.039-3.008=0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.754-271.762=-0.008
σ0.006-0.007=-0.001
min271.746-271.753=-0.007
max271.760-271.770=-0.010
mean2813.000-2897.000=-84.000
σ0.000
min2813.000-2897.000=-84.000
max2813.000-2897.000=-84.000
mean0.382-0.387=-0.005
σ0.005-0.005=0.001
min0.378-0.381=-0.003
max0.392-0.394=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1932.175-1932.179=-0.003
σ0.005-0.008=-0.003
min1932.171-1932.169=0.002
max1932.183-1932.188=-0.005
mean2813.000-2897.000=-84.000
σ0.000
min2813.000-2897.000=-84.000
max2813.000-2897.000=-84.000
mean3.024-3.013=0.010
σ0.071-0.061=0.010
min2.972-2.972=-0.000
max3.149-3.116=0.033
iters=5
new-facts=6402
prior-facts=1
mean4752.769-4752.894=-0.125
σ1.030-0.867=0.164
min4751.874-4752.385=-0.510
max4754.549-4754.436=0.114
mean2813.000-2897.000=-84.000
σ0.000
min2813.000-2897.000=-84.000
max2813.000-2897.000=-84.000
mean8.726-8.726=-0.001
σ0.382-0.330=0.052
min8.282-8.441=-0.158
max9.051-9.257=-0.206
iters=5
new-facts=6402
prior-facts=6402
mean4943.379-4943.371=0.008
σ0.019-0.013=0.006
min4943.358-4943.355=0.004
max4943.401-4943.388=0.013
mean3005.800-3038.400=-32.600
σ208.541-169.475=39.066
min2813.000-2897.000=-84.000
max3317.000-3312.000=5.000
mean8.537-8.575=-0.038
σ0.065-0.074=-0.008
min8.473-8.498=-0.024
max8.637-8.650=-0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.095-1.054=0.040
σ0.218-0.128=0.090
min0.935-0.940=-0.005
max1.378-1.252=0.127

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.859-467.857=0.002
σ575.934-575.926=0.008
min179.886-179.884=0.002
max1331.760-1331.746=0.014
mean86.250
σ8.500
min82.000
max99.000
mean2813.000-2897.000=-84.000
σ0.000
min2813.000-2897.000=-84.000
max2813.000-2897.000=-84.000
mean0.478-0.447=0.032
σ0.400-0.306=0.094
min0.269-0.289=-0.020
max1.078-0.906=0.172
policies=20
mean1799.144-1799.167=-0.022
σ0.331-0.374=-0.043
min1798.906-1798.890=0.015
max1799.635-1799.713=-0.079
mean820.000
σ0.000
min820.000
max820.000
mean2813.000-2897.000=-84.000
σ0.000
min2813.000-2897.000=-84.000
max2813.000-2897.000=-84.000
mean2.803-2.907=-0.104
σ0.011-0.006=0.005
min2.788-2.898=-0.110
max2.813-2.912=-0.098
policies=200
mean17998.287-17998.515=-0.228
σ0.451-0.495=-0.045
min17997.991-17998.221=-0.230
max17998.959-17999.254=-0.296
mean8200.000
σ0.000
min8200.000
max8200.000
mean2813.000-2897.000=-84.000
σ0.000
min2813.000-2897.000=-84.000
max2813.000-2897.000=-84.000
mean28.287-28.703=-0.417
σ0.143-0.486=-0.343
min28.138-28.243=-0.105
max28.481-29.204=-0.723