Compare commits

Home / Compare 3d66ec2a .. 21829311

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.242=0.003
σ0.050-0.054=-0.003
min35.216-35.206=0.010
max35.386-35.392=-0.006
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.085-0.082=0.003
σ0.004-0.004=-0.000
min0.083-0.076=0.007
max0.092-0.087=0.005
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.003=-0.000
min23.765-23.763=0.001
max23.774-23.774=-0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.066-0.065=0.001
σ0.004-0.004=0.000
min0.061-0.061=-0.001
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=-0.000
σ0.365-0.364=0.001
min1755.909-1755.912=-0.003
max1757.074-1757.074=0.000
mean1656.200-1655.700=0.500
σ643.175-634.587=8.588
min627.000-689.000=-62.000
max2796.000-2840.000=-44.000
mean2.369-2.329=0.040
σ0.100-0.123=-0.023
min2.259-2.144=0.115
max2.657-2.592=0.064

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.699-324.701=-0.002
σ0.057-0.055=0.002
min324.598-324.603=-0.005
max324.734-324.732=0.002
mean2796.000-2840.000=-44.000
σ0.000
min2796.000-2840.000=-44.000
max2796.000-2840.000=-44.000
mean0.424-0.424=0.000
σ0.002-0.001=0.001
min0.422-0.423=-0.001
max0.426-0.425=0.002
iters=5
new-facts=1
prior-facts=6402
mean1985.251-1985.255=-0.004
σ0.023-0.017=0.007
min1985.215-1985.229=-0.014
max1985.267-1985.271=-0.003
mean2796.000-2840.000=-44.000
σ0.000
min2796.000-2840.000=-44.000
max2796.000-2840.000=-44.000
mean2.614-2.623=-0.009
σ0.055-0.164=-0.109
min2.544-2.517=0.027
max2.687-2.913=-0.226
iters=5
new-facts=6402
prior-facts=1
mean4808.864-4808.776=0.088
σ7.708-7.720=-0.012
min4805.367-4804.827=0.539
max4822.652-4822.575=0.076
mean2796.000-2840.000=-44.000
σ0.000
min2796.000-2840.000=-44.000
max2796.000-2840.000=-44.000
mean8.929-8.358=0.571
σ0.223-0.497=-0.273
min8.561-7.688=0.874
max9.100-8.887=0.213
iters=5
new-facts=6402
prior-facts=6402
mean4996.466-4996.388=0.078
σ0.016-0.154=-0.138
min4996.448-4996.117=0.331
max4996.486-4996.481=0.005
mean3037.600-3052.600=-15.000
σ250.899-292.244=-41.345
min2796.000-2840.000=-44.000
max3394.000-3513.000=-119.000
mean8.684-8.502=0.182
σ0.196-0.114=0.082
min8.505-8.350=0.156
max8.991-8.654=0.337

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.994-0.958=0.036
σ0.063-0.059=0.004
min0.914-0.923=-0.009
max1.045-1.061=-0.016

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.968=0.009
σ574.253-574.247=0.006
min175.838-175.839=-0.001
max1324.356-1324.339=0.018
mean86.250
σ8.500
min82.000
max99.000
mean2796.000-2840.000=-44.000
σ0.000
min2796.000-2840.000=-44.000
max2796.000-2840.000=-44.000
mean0.469-0.435=0.034
σ0.368-0.302=0.066
min0.280-0.281=-0.001
max1.022-0.888=0.134
policies=20
mean1758.720-1758.690=0.030
σ0.348-0.350=-0.003
min1758.479-1758.465=0.014
max1759.233-1759.211=0.022
mean820.000
σ0.000
min820.000
max820.000
mean2796.000-2840.000=-44.000
σ0.000
min2796.000-2840.000=-44.000
max2796.000-2840.000=-44.000
mean2.805-2.791=0.014
σ0.010-0.014=-0.004
min2.791-2.778=0.013
max2.812-2.809=0.004
policies=200
mean17592.349-17593.286=-0.938
σ0.627-0.544=0.083
min17592.006-17592.556=-0.551
max17593.287-17593.806=-0.519
mean8200.000
σ0.000
min8200.000
max8200.000
mean2796.000-2840.000=-44.000
σ0.000
min2796.000-2840.000=-44.000
max2796.000-2840.000=-44.000
mean27.604-27.808=-0.205
σ0.120-0.326=-0.206
min27.446-27.483=-0.037
max27.739-28.189=-0.450