Compare commits

Home / Compare 2876cd1d .. c490ce54

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.001
σ0.054-0.055=-0.001
min35.590-35.592=-0.003
max35.768-35.772=-0.004
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.085-0.085=-0.000
σ0.005-0.005=-0.000
min0.082-0.078=0.003
max0.094-0.094=0.001
cache=y
dps=1
iters=10
policies=100
mean24.046-24.047=-0.001
σ0.002-0.004=-0.001
min24.043-24.040=0.002
max24.049-24.051=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.066-0.065=0.001
σ0.004-0.004=0.000
min0.062-0.061=0.001
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.489=0.003
σ0.364-0.364=0.000
min1755.916-1755.917=-0.001
max1757.078-1757.075=0.003
mean1647.450-1644.850=2.600
σ642.258-635.934=6.324
min649.000-625.000=24.000
max2831.000-2749.000=82.000
mean2.340-2.349=-0.009
σ0.095-0.124=-0.029
min2.149-2.260=-0.112
max2.602-2.776=-0.175

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.757-324.764=-0.007
σ0.059-0.048=0.011
min324.653-324.679=-0.026
max324.790-324.794=-0.004
mean2831.000-2749.000=82.000
σ0.000
min2831.000-2749.000=82.000
max2831.000-2749.000=82.000
mean0.428-0.425=0.003
σ0.008-0.006=0.002
min0.423-0.423=0.000
max0.442-0.436=0.007
iters=5
new-facts=1
prior-facts=6402
mean1985.327-1985.320=0.007
σ0.010-0.014=-0.005
min1985.311-1985.301=0.010
max1985.336-1985.336=0.000
mean2831.000-2749.000=82.000
σ0.000
min2831.000-2749.000=82.000
max2831.000-2749.000=82.000
mean2.676-2.712=-0.035
σ0.133-0.237=-0.103
min2.551-2.493=0.058
max2.845-3.099=-0.254
iters=5
new-facts=6402
prior-facts=1
mean4809.005-4809.076=-0.071
σ7.745-7.714=0.031
min4805.023-4805.582=-0.559
max4822.848-4822.875=-0.026
mean2831.000-2749.000=82.000
σ0.000
min2831.000-2749.000=82.000
max2831.000-2749.000=82.000
mean8.561-8.654=-0.093
σ0.561-0.538=0.023
min7.960-7.771=0.189
max9.166-9.136=0.030
iters=5
new-facts=6402
prior-facts=6402
mean4996.628-4996.615=0.013
σ0.023-0.016=0.007
min4996.598-4996.596=0.002
max4996.654-4996.634=0.020
mean3051.400-3015.600=35.800
σ262.626-322.094=-59.468
min2831.000-2749.000=82.000
max3431.000-3500.000=-69.000
mean8.540-8.445=0.095
σ0.199-0.130=0.069
min8.409-8.317=0.092
max8.891-8.662=0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.025-0.947=0.078
σ0.046-0.057=-0.010
min0.944-0.909=0.035
max1.052-1.046=0.006

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.205=0.003
σ574.771-574.769=0.002
min175.820-175.815=0.005
max1325.365-1325.359=0.006
mean86.250
σ8.500
min82.000
max99.000
mean2831.000-2749.000=82.000
σ0.000
min2831.000-2749.000=82.000
max2831.000-2749.000=82.000
mean0.432-0.435=-0.003
σ0.299-0.298=0.001
min0.280-0.284=-0.004
max0.881-0.882=-0.001
policies=20
mean1758.534-1758.580=-0.046
σ0.350-0.347=0.003
min1758.294-1758.302=-0.008
max1759.052-1759.059=-0.007
mean820.000
σ0.000
min820.000
max820.000
mean2831.000-2749.000=82.000
σ0.000
min2831.000-2749.000=82.000
max2831.000-2749.000=82.000
mean2.790-2.806=-0.016
σ0.003-0.106=-0.104
min2.786-2.694=0.092
max2.792-2.951=-0.158
policies=200
mean17592.114-17592.110=0.004
σ0.424-0.474=-0.051
min17591.706-17591.861=-0.155
max17592.708-17592.821=-0.113
mean8200.000
σ0.000
min8200.000
max8200.000
mean2831.000-2749.000=82.000
σ0.000
min2831.000-2749.000=82.000
max2831.000-2749.000=82.000
mean27.873-27.339=0.535
σ0.397-0.116=0.280
min27.491-27.204=0.287
max28.291-27.473=0.819