Compare commits

Home / Compare 1b066982 .. 4d196739

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.388-70.388=0.000
σ0.046-0.044=0.002
min70.361-70.362=-0.001
max70.515-70.510=0.006
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.153-0.159=-0.005
σ0.006-0.003=0.002
min0.148-0.155=-0.007
max0.164-0.164=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.003-0.003=0.000
min21.141-21.140=0.001
max21.151-21.150=0.001
mean412.800-415.000=-2.200
σ0.422-0.000=0.422
min412.000-415.000=-3.000
max413.000-415.000=-2.000
mean0.063-0.064=-0.001
σ0.003-0.002=0.001
min0.057-0.062=-0.005
max0.066-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.395-1752.395=-0.001
σ0.362-0.362=-0.000
min1751.831-1751.824=0.007
max1752.982-1752.984=-0.002
mean1654.450-1649.450=5.000
σ629.594-627.418=2.176
min617.000-619.000=-2.000
max2771.000-2662.000=109.000
mean2.831-2.849=-0.018
σ0.147-0.133=0.014
min2.352-2.584=-0.231
max3.058-3.074=-0.016

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.140-270.141=-0.001
σ0.007-0.007=0.000
min270.131-270.135=-0.004
max270.148-270.152=-0.003
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean0.378-0.377=0.001
σ0.005-0.003=0.002
min0.370-0.372=-0.002
max0.383-0.379=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.613-1930.597=0.016
σ0.007-0.017=-0.010
min1930.602-1930.573=0.028
max1930.620-1930.618=0.002
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean2.481-2.567=-0.086
σ0.038-0.121=-0.083
min2.443-2.434=0.009
max2.523-2.721=-0.199
iters=5
new-facts=6402
prior-facts=1
mean4751.364-4751.127=0.236
σ0.840-0.754=0.086
min4750.891-4750.344=0.547
max4752.858-4752.372=0.486
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean8.256-8.266=-0.010
σ0.415-0.515=-0.100
min7.653-7.660=-0.007
max8.619-8.932=-0.313
iters=5
new-facts=6402
prior-facts=6402
mean4941.777-4941.696=0.081
σ0.023-0.163=-0.140
min4941.756-4941.409=0.347
max4941.812-4941.795=0.017
mean3031.400-2996.600=34.800
σ209.027-363.796=-154.769
min2771.000-2662.000=109.000
max3314.000-3511.000=-197.000
mean8.593-8.584=0.009
σ0.328-0.352=-0.025
min8.322-8.304=0.018
max9.124-9.176=-0.052

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.040-1.156=-0.116
σ0.191-0.323=-0.132
min0.923-0.931=-0.007
max1.367-1.640=-0.273

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.376-466.378=-0.003
σ575.940-575.951=-0.012
min178.401-178.399=0.002
max1330.285-1330.305=-0.020
mean84.250
σ8.500
min80.000
max97.000
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean0.439-0.554=-0.115
σ0.303-0.548=-0.244
min0.286-0.277=0.009
max0.894-1.375=-0.481
policies=20
mean1784.337-1784.322=0.015
σ0.339-0.348=-0.009
min1784.101-1784.095=0.006
max1784.831-1784.839=-0.007
mean800.000
σ0.000
min800.000
max800.000
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean2.828-2.816=0.012
σ0.121-0.046=0.075
min2.763-2.772=-0.008
max3.009-2.877=0.132
policies=200
mean17849.769-17849.742=0.027
σ0.431-0.518=-0.087
min17849.499-17849.436=0.063
max17850.409-17850.517=-0.108
mean8000.000
σ0.000
min8000.000
max8000.000
mean2771.000-2662.000=109.000
σ0.000
min2771.000-2662.000=109.000
max2771.000-2662.000=109.000
mean27.957-28.063=-0.106
σ0.121-0.171=-0.050
min27.838-27.953=-0.116
max28.091-28.316=-0.225