Compare commits

Home / Compare a18eba56 .. 496ab33c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.263=0.001
σ0.055-0.055=0.001
min35.230-35.231=-0.001
max35.418-35.416=0.002
mean413.000-414.600=-1.600
σ0.000-0.516=-0.516
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.083-0.085=-0.002
σ0.004-0.004=-0.000
min0.077-0.081=-0.005
max0.088-0.092=-0.004
cache=y
dps=1
iters=10
policies=100
mean23.769-23.769=-0.000
σ0.003-0.003=0.000
min23.764-23.764=0.001
max23.774-23.774=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.067-0.066=0.000
σ0.005-0.004=0.001
min0.061-0.061=-0.001
max0.076-0.073=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.485=0.000
σ0.366-0.365=0.001
min1755.909-1755.910=-0.002
max1757.079-1757.085=-0.006
mean1646.300-1649.750=-3.450
σ639.692-644.632=-4.939
min623.000-643.000=-20.000
max2823.000-2840.000=-17.000
mean2.330-2.329=0.001
σ0.067-0.098=-0.031
min2.238-2.151=0.087
max2.468-2.597=-0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.682-324.713=-0.031
σ0.051-0.038=0.013
min324.593-324.646=-0.053
max324.716-324.737=-0.021
mean2823.000-2840.000=-17.000
σ0.000
min2823.000-2840.000=-17.000
max2823.000-2840.000=-17.000
mean0.438-0.424=0.014
σ0.017-0.001=0.016
min0.425-0.422=0.002
max0.466-0.426=0.040
iters=5
new-facts=1
prior-facts=6402
mean1985.266-1985.273=-0.007
σ0.010-0.007=0.003
min1985.250-1985.267=-0.018
max1985.274-1985.285=-0.011
mean2823.000-2840.000=-17.000
σ0.000
min2823.000-2840.000=-17.000
max2823.000-2840.000=-17.000
mean2.687-2.617=0.070
σ0.163-0.084=0.079
min2.510-2.553=-0.043
max2.890-2.728=0.162
iters=5
new-facts=6402
prior-facts=1
mean4808.672-4808.863=-0.191
σ7.216-7.653=-0.437
min4805.422-4805.387=0.035
max4821.581-4822.554=-0.973
mean2823.000-2840.000=-17.000
σ0.000
min2823.000-2840.000=-17.000
max2823.000-2840.000=-17.000
mean9.145-8.926=0.220
σ0.200-0.201=-0.002
min8.977-8.636=0.341
max9.469-9.136=0.333
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.465=0.001
σ0.018-0.019=-0.001
min4996.446-4996.445=0.002
max4996.489-4996.490=-0.001
mean3029.400-3041.400=-12.000
σ281.789-211.079=70.710
min2823.000-2840.000=-17.000
max3471.000-3345.000=126.000
mean8.507-8.641=-0.134
σ0.127-0.183=-0.055
min8.359-8.493=-0.134
max8.699-8.935=-0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-1.006=-0.033
σ0.067-0.064=0.003
min0.916-0.920=-0.004
max1.052-1.059=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.972-462.968=0.004
σ574.256-574.252=0.003
min175.836-175.836=-0.000
max1324.355-1324.346=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2823.000-2840.000=-17.000
σ0.000
min2823.000-2840.000=-17.000
max2823.000-2840.000=-17.000
mean0.431-0.464=-0.033
σ0.298-0.368=-0.069
min0.278-0.278=0.000
max0.879-1.016=-0.137
policies=20
mean1758.718-1758.714=0.005
σ0.342-0.357=-0.015
min1758.487-1758.464=0.023
max1759.225-1759.242=-0.017
mean820.000
σ0.000
min820.000
max820.000
mean2823.000-2840.000=-17.000
σ0.000
min2823.000-2840.000=-17.000
max2823.000-2840.000=-17.000
mean2.799-2.782=0.017
σ0.004-0.019=-0.015
min2.794-2.754=0.040
max2.801-2.794=0.008
policies=200
mean17593.366-17593.365=0.001
σ0.723-0.631=0.093
min17592.370-17592.632=-0.261
max17593.930-17593.900=0.031
mean8200.000
σ0.000
min8200.000
max8200.000
mean2823.000-2840.000=-17.000
σ0.000
min2823.000-2840.000=-17.000
max2823.000-2840.000=-17.000
mean27.935-27.936=-0.002
σ0.353-0.367=-0.015
min27.588-27.583=0.005
max28.350-28.410=-0.060