Compare commits

Home / Compare 212dcd27 .. 018d293c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.388-70.380=0.008
σ0.043-0.046=-0.002
min70.364-70.350=0.014
max70.509-70.507=0.002
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.155-0.162=-0.007
σ0.005-0.003=0.002
min0.148-0.157=-0.010
max0.164-0.167=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.143-21.144=-0.001
σ0.002-0.002=-0.001
min21.141-21.141=0.000
max21.146-21.149=-0.003
mean415.000-413.800=1.200
σ0.000-0.422=-0.422
min415.000-413.000=2.000
max415.000-414.000=1.000
mean0.064-0.067=-0.003
σ0.002-0.003=-0.001
min0.063-0.064=-0.001
max0.070-0.074=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.387=0.007
σ0.360-0.362=-0.002
min1751.827-1751.816=0.011
max1752.955-1752.971=-0.016
mean1629.750-1656.350=-26.600
σ589.619-638.034=-48.414
min626.000-623.000=3.000
max2416.000-2822.000=-406.000
mean2.809-2.817=-0.008
σ0.161-0.162=-0.001
min2.354-2.386=-0.032
max3.083-3.019=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.239-270.220=0.019
σ0.006-0.008=-0.002
min270.231-270.212=0.019
max270.246-270.233=0.012
mean2416.000-2822.000=-406.000
σ0.000
min2416.000-2822.000=-406.000
max2416.000-2822.000=-406.000
mean0.382-0.372=0.010
σ0.005-0.003=0.003
min0.378-0.371=0.008
max0.392-0.377=0.014
iters=5
new-facts=1
prior-facts=6402
mean1930.697-1930.689=0.008
σ0.011-0.009=0.002
min1930.683-1930.676=0.007
max1930.711-1930.698=0.013
mean2416.000-2822.000=-406.000
σ0.000
min2416.000-2822.000=-406.000
max2416.000-2822.000=-406.000
mean2.627-2.630=-0.003
σ0.174-0.117=0.058
min2.462-2.461=0.002
max2.854-2.789=0.065
iters=5
new-facts=6402
prior-facts=1
mean4751.480-4751.160=0.320
σ0.825-0.838=-0.013
min4751.011-4750.590=0.420
max4752.951-4752.645=0.306
mean2416.000-2822.000=-406.000
σ0.000
min2416.000-2822.000=-406.000
max2416.000-2822.000=-406.000
mean7.875-8.525=-0.649
σ0.369-0.451=-0.082
min7.571-7.827=-0.256
max8.506-9.024=-0.518
iters=5
new-facts=6402
prior-facts=6402
mean4941.869-4941.552=0.316
σ0.015-0.209=-0.194
min4941.849-4941.206=0.642
max4941.883-4941.726=0.156
mean2925.600-3088.000=-162.400
σ411.219-280.510=130.709
min2416.000-2822.000=-406.000
max3436.000-3380.000=56.000
mean8.541-8.690=-0.149
σ0.110-0.271=-0.161
min8.413-8.412=0.001
max8.672-8.968=-0.296

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.829-1.059=0.770
σ0.034-0.125=-0.091
min1.802-0.943=0.859
max1.886-1.249=0.637

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.360-466.355=0.005
σ575.918-575.926=-0.008
min178.399-178.389=0.010
max1330.236-1330.244=-0.008
mean84.000
σ8.000
min80.000
max96.000
mean2416.000-2822.000=-406.000
σ0.000
min2416.000-2822.000=-406.000
max2416.000-2822.000=-406.000
mean0.561-0.435=0.126
σ0.561-0.293=0.268
min0.279-0.284=-0.006
max1.403-0.874=0.529
policies=20
mean1784.300-1784.246=0.055
σ0.357-0.360=-0.003
min1784.072-1783.998=0.075
max1784.832-1784.776=0.056
mean800.000
σ0.000
min800.000
max800.000
mean2416.000-2822.000=-406.000
σ0.000
min2416.000-2822.000=-406.000
max2416.000-2822.000=-406.000
mean2.774-2.899=-0.126
σ0.020-0.076=-0.056
min2.747-2.851=-0.104
max2.793-3.013=-0.220
policies=200
mean17849.630-17848.797=0.833
σ0.463-0.505=-0.042
min17849.358-17848.377=0.982
max17850.322-17849.512=0.810
mean8000.000
σ0.000
min8000.000
max8000.000
mean2416.000-2822.000=-406.000
σ0.000
min2416.000-2822.000=-406.000
max2416.000-2822.000=-406.000
mean27.960-27.995=-0.035
σ0.095-0.095=-0.000
min27.844-27.938=-0.094
max28.054-28.137=-0.083