Compare commits

Home / Compare bd345359 .. 65d25477

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.053-0.054=-0.000
min35.230-35.230=-0.000
max35.412-35.414=-0.002
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.082-0.085=-0.003
σ0.005-0.004=0.001
min0.077-0.081=-0.004
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean23.769-23.770=-0.001
σ0.004-0.003=0.001
min23.764-23.764=-0.001
max23.776-23.777=-0.000
mean414.700-412.000=2.700
σ0.483-0.000=0.483
min414.000-412.000=2.000
max415.000-412.000=3.000
mean0.066-0.069=-0.003
σ0.005-0.004=0.001
min0.060-0.066=-0.006
max0.074-0.076=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.472-1756.472=0.000
σ0.365-0.365=0.000
min1755.896-1755.895=0.001
max1757.057-1757.061=-0.004
mean1626.600-1659.000=-32.400
σ591.585-647.517=-55.932
min652.000-627.000=25.000
max2422.000-2812.000=-390.000
mean2.345-2.343=0.002
σ0.107-0.108=-0.001
min2.215-2.250=-0.036
max2.670-2.700=-0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.682-324.694=-0.012
σ0.048-0.043=0.006
min324.596-324.619=-0.024
max324.707-324.724=-0.017
mean2422.000-2812.000=-390.000
σ0.000
min2422.000-2812.000=-390.000
max2422.000-2812.000=-390.000
mean0.431-0.424=0.007
σ0.011-0.004=0.007
min0.423-0.421=0.003
max0.449-0.431=0.017
iters=5
new-facts=1
prior-facts=6402
mean1985.253-1985.244=0.009
σ0.012-0.015=-0.003
min1985.233-1985.224=0.009
max1985.265-1985.260=0.005
mean2422.000-2812.000=-390.000
σ0.000
min2422.000-2812.000=-390.000
max2422.000-2812.000=-390.000
mean2.674-2.685=-0.011
σ0.194-0.126=0.068
min2.475-2.544=-0.069
max2.979-2.819=0.160
iters=5
new-facts=6402
prior-facts=1
mean4808.858-4808.789=0.069
σ7.690-7.706=-0.016
min4805.410-4804.781=0.629
max4822.615-4822.561=0.053
mean2422.000-2812.000=-390.000
σ0.000
min2422.000-2812.000=-390.000
max2422.000-2812.000=-390.000
mean8.975-8.806=0.168
σ0.109-0.629=-0.520
min8.884-7.789=1.095
max9.160-9.447=-0.287
iters=5
new-facts=6402
prior-facts=6402
mean4996.375-4996.446=-0.071
σ0.145-0.017=0.128
min4996.117-4996.429=-0.311
max4996.466-4996.465=0.001
mean2937.600-3002.400=-64.800
σ449.491-269.372=180.119
min2422.000-2812.000=-390.000
max3538.000-3423.000=115.000
mean8.524-8.542=-0.018
σ0.123-0.104=0.020
min8.440-8.479=-0.039
max8.740-8.723=0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.672-1.000=0.673
σ0.182-0.124=0.058
min1.348-0.917=0.430
max1.772-1.200=0.572

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.924-462.954=-0.029
σ574.245-574.253=-0.009
min175.798-175.814=-0.016
max1324.291-1324.333=-0.042
mean86.250
σ8.500
min82.000
max99.000
mean2422.000-2812.000=-390.000
σ0.000
min2422.000-2812.000=-390.000
max2422.000-2812.000=-390.000
mean0.551-0.431=0.119
σ0.552-0.301=0.252
min0.272-0.279=-0.008
max1.379-0.882=0.497
policies=20
mean1758.299-1758.492=-0.193
σ0.350-0.360=-0.010
min1758.062-1758.246=-0.185
max1758.819-1759.026=-0.208
mean820.000
σ0.000
min820.000
max820.000
mean2422.000-2812.000=-390.000
σ0.000
min2422.000-2812.000=-390.000
max2422.000-2812.000=-390.000
mean2.735-2.771=-0.036
σ0.022-0.012=0.009
min2.712-2.760=-0.048
max2.763-2.783=-0.020
policies=200
mean17590.124-17590.266=-0.143
σ0.535-0.543=-0.008
min17589.757-17589.788=-0.031
max17590.912-17590.867=0.045
mean8200.000
σ0.000
min8200.000
max8200.000
mean2422.000-2812.000=-390.000
σ0.000
min2422.000-2812.000=-390.000
max2422.000-2812.000=-390.000
mean27.560-27.465=0.095
σ0.226-0.140=0.086
min27.388-27.304=0.084
max27.886-27.645=0.241