Compare commits

Home / Compare 4a8621d4 .. d246aa57

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.618=-0.001
σ0.055-0.054=0.001
min35.586-35.589=-0.003
max35.773-35.772=0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.085-0.086=-0.001
σ0.003-0.004=-0.001
min0.082-0.082=-0.000
max0.092-0.094=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.003-0.003=-0.000
min24.044-24.044=-0.001
max24.053-24.052=0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.067-0.069=-0.002
σ0.004-0.003=0.001
min0.061-0.066=-0.005
max0.073-0.077=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.490=-0.001
σ0.364-0.366=-0.002
min1755.918-1755.915=0.003
max1757.081-1757.078=0.003
mean1659.550-1625.250=34.300
σ639.153-593.044=46.109
min632.000-657.000=-25.000
max2781.000-2423.000=358.000
mean2.375-2.316=0.059
σ0.127-0.072=0.054
min2.251-2.250=0.000
max2.844-2.483=0.361

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.759-324.740=0.019
σ0.053-0.048=0.005
min324.664-324.654=0.010
max324.788-324.765=0.023
mean2781.000-2423.000=358.000
σ0.000
min2781.000-2423.000=358.000
max2781.000-2423.000=358.000
mean0.426-0.433=-0.007
σ0.008-0.008=-0.000
min0.421-0.425=-0.004
max0.441-0.445=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1985.322-1985.321=0.000
σ0.016-0.024=-0.008
min1985.301-1985.281=0.020
max1985.338-1985.339=-0.001
mean2781.000-2423.000=358.000
σ0.000
min2781.000-2423.000=358.000
max2781.000-2423.000=358.000
mean2.637-2.577=0.061
σ0.127-0.080=0.047
min2.513-2.467=0.046
max2.832-2.677=0.154
iters=5
new-facts=6402
prior-facts=1
mean4808.852-4809.080=-0.228
σ7.838-7.729=0.108
min4805.034-4805.592=-0.558
max4822.865-4822.907=-0.042
mean2781.000-2423.000=358.000
σ0.000
min2781.000-2423.000=358.000
max2781.000-2423.000=358.000
mean8.756-9.020=-0.264
σ0.195-0.251=-0.057
min8.465-8.823=-0.358
max8.985-9.455=-0.471
iters=5
new-facts=6402
prior-facts=6402
mean4816.406-4996.629=-180.223
σ402.780-0.021=402.759
min4095.891-4996.602=-900.711
max4996.656-4996.652=0.004
mean3023.200-2998.400=24.800
σ297.616-257.924=39.692
min2781.000-2615.000=166.000
max3473.000-3306.000=167.000
mean8.368-8.627=-0.258
σ0.608-0.152=0.456
min7.339-8.365=-1.026
max8.881-8.754=0.127

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.944-1.541=-0.597
σ0.056-0.193=-0.137
min0.912-1.205=-0.294
max1.042-1.668=-0.626

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.208-463.203=0.005
σ574.774-574.767=0.007
min175.813-175.813=-0.000
max1325.368-1325.353=0.016
mean86.250
σ8.500
min82.000
max99.000
mean2781.000-2423.000=358.000
σ0.000
min2781.000-2423.000=358.000
max2781.000-2423.000=358.000
mean0.432-0.543=-0.112
σ0.302-0.540=-0.237
min0.279-0.265=0.014
max0.885-1.353=-0.468
policies=20
mean1758.513-1758.470=0.043
σ0.346-0.346=-0.000
min1758.284-1758.229=0.056
max1759.026-1758.982=0.045
mean820.000
σ0.000
min820.000
max820.000
mean2781.000-2423.000=358.000
σ0.000
min2781.000-2423.000=358.000
max2781.000-2423.000=358.000
mean2.785-2.716=0.068
σ0.008-0.008=-0.000
min2.776-2.707=0.069
max2.794-2.726=0.067
policies=200
mean17591.936-17592.140=-0.205
σ0.373-0.504=-0.131
min17591.735-17591.838=-0.103
max17592.494-17592.893=-0.400
mean8200.000
σ0.000
min8200.000
max8200.000
mean2781.000-2423.000=358.000
σ0.000
min2781.000-2423.000=358.000
max2781.000-2423.000=358.000
mean27.560-27.424=0.136
σ0.077-0.120=-0.043
min27.444-27.307=0.138
max27.609-27.532=0.077