Compare commits

Home / Compare d5f8c16c .. 7aff85b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.264-35.244=0.019
σ0.053-0.055=-0.003
min35.234-35.217=0.017
max35.412-35.401=0.011
mean415.300-411.000=4.300
σ0.483-0.000=0.483
min415.000-411.000=4.000
max416.000-411.000=5.000
mean0.085-0.083=0.002
σ0.004-0.004=-0.000
min0.082-0.077=0.006
max0.092-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.003-0.004=-0.001
min23.767-23.764=0.004
max23.774-23.775=-0.002
mean416.000-411.000=5.000
σ0.000
min416.000-411.000=5.000
max416.000-411.000=5.000
mean0.068-0.066=0.002
σ0.003-0.002=0.001
min0.066-0.062=0.004
max0.074-0.067=0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1756.364=0.122
σ0.366-0.365=0.001
min1755.909-1755.788=0.121
max1757.074-1756.947=0.127
mean1640.350-1654.550=-14.200
σ604.394-639.528=-35.134
min651.000-674.000=-23.000
max2451.000-2843.000=-392.000
mean2.351-2.325=0.026
σ0.124-0.070=0.055
min2.170-2.222=-0.052
max2.665-2.475=0.190

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.712-324.580=0.132
σ0.037-0.063=-0.027
min324.646-324.468=0.178
max324.730-324.617=0.113
mean2451.000-2843.000=-392.000
σ0.000
min2451.000-2843.000=-392.000
max2451.000-2843.000=-392.000
mean0.425-0.429=-0.004
σ0.001-0.011=-0.010
min0.423-0.423=0.000
max0.426-0.448=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.147=0.115
σ0.020-0.012=0.008
min1985.227-1985.128=0.099
max1985.276-1985.157=0.120
mean2451.000-2843.000=-392.000
σ0.000
min2451.000-2843.000=-392.000
max2451.000-2843.000=-392.000
mean2.671-2.611=0.060
σ0.181-0.071=0.111
min2.482-2.546=-0.064
max2.874-2.730=0.144
iters=5
new-facts=6402
prior-facts=1
mean4808.861-4808.738=0.123
σ7.671-7.677=-0.006
min4805.331-4805.274=0.057
max4822.583-4822.471=0.112
mean2451.000-2843.000=-392.000
σ0.000
min2451.000-2843.000=-392.000
max2451.000-2843.000=-392.000
mean8.871-8.917=-0.045
σ0.230-0.149=0.081
min8.605-8.701=-0.096
max9.121-9.086=0.035
iters=5
new-facts=6402
prior-facts=6402
mean4996.467-4996.269=0.197
σ0.018-0.170=-0.152
min4996.438-4995.966=0.472
max4996.482-4996.357=0.126
mean2945.800-3062.200=-116.400
σ444.588-301.057=143.531
min2451.000-2843.000=-392.000
max3546.000-3531.000=15.000
mean8.461-8.615=-0.154
σ0.104-0.334=-0.230
min8.356-8.408=-0.052
max8.617-9.206=-0.589

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.643-0.945=0.698
σ0.124-0.057=0.067
min1.450-0.911=0.539
max1.770-1.045=0.725

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.944-462.968=-0.024
σ574.246-574.248=-0.003
min175.817-175.838=-0.020
max1324.313-1324.341=-0.028
mean86.250
σ8.500
min82.000
max99.000
mean2451.000-2843.000=-392.000
σ0.000
min2451.000-2843.000=-392.000
max2451.000-2843.000=-392.000
mean0.552-0.422=0.130
σ0.552-0.280=0.272
min0.274-0.279=-0.005
max1.380-0.842=0.538
policies=20
mean1758.517-1758.718=-0.200
σ0.345-0.343=0.002
min1758.265-1758.503=-0.238
max1759.025-1759.229=-0.203
mean820.000
σ0.000
min820.000
max820.000
mean2451.000-2843.000=-392.000
σ0.000
min2451.000-2843.000=-392.000
max2451.000-2843.000=-392.000
mean2.714-2.784=-0.070
σ0.017-0.016=0.001
min2.695-2.761=-0.067
max2.730-2.795=-0.065
policies=200
mean17592.342-17593.247=-0.906
σ0.447-0.455=-0.008
min17591.996-17592.623=-0.627
max17592.989-17593.601=-0.612
mean8200.000
σ0.000
min8200.000
max8200.000
mean2451.000-2843.000=-392.000
σ0.000
min2451.000-2843.000=-392.000
max2451.000-2843.000=-392.000
mean27.600-27.895=-0.295
σ0.108-0.313=-0.205
min27.512-27.550=-0.038
max27.735-28.191=-0.456