Compare commits

Home / Compare 1be5e4d6 .. 93512df0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.373=-0.000
σ0.057-0.057=-0.000
min70.333-70.336=-0.003
max70.531-70.532=-0.001
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.158-0.157=0.000
σ0.005-0.006=-0.001
min0.150-0.150=0.000
max0.164-0.168=-0.005
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.003=-0.001
min21.140-21.138=0.002
max21.146-21.147=-0.001
mean410.000-413.000=-3.000
σ0.000
min410.000-413.000=-3.000
max410.000-413.000=-3.000
mean0.064-0.063=0.002
σ0.003-0.004=-0.001
min0.063-0.058=0.005
max0.072-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1752.200=-0.002
σ0.360-0.360=-0.000
min1751.625-1751.626=-0.002
max1752.789-1752.799=-0.011
mean1646.150-1652.150=-6.000
σ624.240-646.049=-21.809
min685.000-645.000=40.000
max2799.000-2845.000=-46.000
mean2.800-2.836=-0.035
σ0.190-0.186=0.003
min2.175-2.248=-0.074
max3.060-3.130=-0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.929-269.933=-0.004
σ0.007-0.011=-0.004
min269.920-269.920=0.000
max269.938-269.946=-0.007
mean2799.000-2845.000=-46.000
σ0.000
min2799.000-2845.000=-46.000
max2799.000-2845.000=-46.000
mean0.373-0.374=-0.001
σ0.006-0.004=0.002
min0.368-0.371=-0.003
max0.383-0.381=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.386-1930.387=-0.001
σ0.018-0.019=-0.001
min1930.362-1930.361=0.001
max1930.404-1930.405=-0.002
mean2799.000-2845.000=-46.000
σ0.000
min2799.000-2845.000=-46.000
max2799.000-2845.000=-46.000
mean2.552-2.564=-0.012
σ0.162-0.139=0.023
min2.434-2.445=-0.011
max2.835-2.797=0.038
iters=5
new-facts=6402
prior-facts=1
mean4750.846-4750.892=-0.046
σ0.807-0.850=-0.043
min4750.289-4750.432=-0.143
max4752.269-4752.405=-0.135
mean2799.000-2845.000=-46.000
σ0.000
min2799.000-2845.000=-46.000
max2799.000-2845.000=-46.000
mean8.703-8.352=0.351
σ0.237-0.397=-0.160
min8.422-7.755=0.667
max9.066-8.866=0.201
iters=5
new-facts=6402
prior-facts=6402
mean4941.336-4941.327=0.009
σ0.081-0.078=0.003
min4941.271-4941.265=0.006
max4941.427-4941.415=0.012
mean3048.000-3031.800=16.200
σ226.000-262.883=-36.883
min2799.000-2845.000=-46.000
max3325.000-3448.000=-123.000
mean8.593-8.391=0.202
σ0.123-0.071=0.052
min8.384-8.294=0.089
max8.701-8.454=0.247

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.076=-0.029
σ0.126-0.109=0.017
min0.935-0.948=-0.013
max1.246-1.250=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.911-465.915=-0.004
σ575.758-575.767=-0.009
min178.026-178.019=0.006
max1329.548-1329.565=-0.018
mean81.750
σ7.500
min78.000
max93.000
mean2799.000-2845.000=-46.000
σ0.000
min2799.000-2845.000=-46.000
max2799.000-2845.000=-46.000
mean0.443-0.444=-0.000
σ0.304-0.308=-0.004
min0.289-0.286=0.003
max0.899-0.906=-0.007
policies=20
mean1780.490-1780.472=0.018
σ0.339-0.358=-0.019
min1780.247-1780.207=0.041
max1780.985-1780.992=-0.007
mean780.000
σ0.000
min780.000
max780.000
mean2799.000-2845.000=-46.000
σ0.000
min2799.000-2845.000=-46.000
max2799.000-2845.000=-46.000
mean2.852-2.867=-0.015
σ0.081-0.010=0.071
min2.765-2.857=-0.092
max2.961-2.880=0.081
policies=200
mean17811.218-17811.328=-0.110
σ0.403-0.492=-0.089
min17810.931-17811.032=-0.100
max17811.811-17812.060=-0.250
mean7800.000
σ0.000
min7800.000
max7800.000
mean2799.000-2845.000=-46.000
σ0.000
min2799.000-2845.000=-46.000
max2799.000-2845.000=-46.000
mean27.919-28.359=-0.440
σ0.143-0.516=-0.374
min27.772-27.858=-0.085
max28.102-28.860=-0.758