Compare commits

Home / Compare f705c60c .. 21266142

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.732-70.695=0.037
σ0.047-0.049=-0.002
min70.702-70.667=0.035
max70.864-70.832=0.032
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.157-0.157=0.000
σ0.004-0.005=-0.001
min0.150-0.151=-0.000
max0.163-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.445-21.424=0.022
σ0.003-0.013=-0.010
min21.440-21.417=0.024
max21.449-21.459=-0.010
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.064-0.065=-0.001
σ0.004-0.003=0.001
min0.059-0.063=-0.005
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.528-1754.460=0.068
σ0.361-0.362=-0.001
min1753.959-1753.888=0.071
max1755.128-1755.038=0.091
mean1663.750-1670.300=-6.550
σ641.887-650.561=-8.674
min643.000-622.000=21.000
max2843.000-2867.000=-24.000
mean2.820-2.786=0.034
σ0.140-0.166=-0.026
min2.565-2.364=0.200
max3.081-2.968=0.113

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.612-273.503=0.109
σ0.007-0.009=-0.002
min273.607-273.493=0.113
max273.623-273.515=0.107
mean2843.000-2867.000=-24.000
σ0.000
min2843.000-2867.000=-24.000
max2843.000-2867.000=-24.000
mean0.389-0.377=0.012
σ0.006-0.004=0.002
min0.383-0.373=0.009
max0.398-0.384=0.014
iters=5
new-facts=1
prior-facts=6402
mean1933.999-1933.902=0.097
σ0.007-0.014=-0.008
min1933.989-1933.887=0.102
max1934.008-1933.925=0.082
mean2843.000-2867.000=-24.000
σ0.000
min2843.000-2867.000=-24.000
max2843.000-2867.000=-24.000
mean2.998-2.878=0.120
σ0.092-0.310=-0.218
min2.872-2.373=0.499
max3.129-3.198=-0.069
iters=5
new-facts=6402
prior-facts=1
mean4754.813-4754.559=0.254
σ0.778-0.889=-0.111
min4754.381-4753.859=0.523
max4756.201-4756.111=0.090
mean2843.000-2867.000=-24.000
σ0.000
min2843.000-2867.000=-24.000
max2843.000-2867.000=-24.000
mean8.216-8.421=-0.205
σ0.242-0.500=-0.258
min7.873-7.637=0.237
max8.530-8.874=-0.344
iters=5
new-facts=6402
prior-facts=6402
mean4945.217-4945.121=0.096
σ0.021-0.023=-0.002
min4945.197-4945.104=0.092
max4945.241-4945.148=0.093
mean3080.400-3073.600=6.800
σ315.407-209.423=105.985
min2843.000-2867.000=-24.000
max3567.000-3360.000=207.000
mean8.484-8.683=-0.199
σ0.171-0.301=-0.130
min8.323-8.402=-0.079
max8.712-9.126=-0.414

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.125-0.988=0.137
σ0.163-0.144=0.019
min0.925-0.920=0.005
max1.328-1.245=0.082

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.843-473.079=-0.236
σ574.942-575.910=-0.968
min185.369-185.114=0.256
max1335.255-1336.943=-1.688
mean88.250
σ8.500
min84.000
max101.000
mean2843.000-2867.000=-24.000
σ0.000
min2843.000-2867.000=-24.000
max2843.000-2867.000=-24.000
mean0.492-0.440=0.052
σ0.379-0.281=0.098
min0.300-0.295=0.005
max1.060-0.862=0.199
policies=20
mean1854.022-1851.454=2.568
σ0.368-0.372=-0.004
min1853.743-1851.179=2.564
max1854.554-1851.994=2.560
mean840.000
σ0.000
min840.000
max840.000
mean2843.000-2867.000=-24.000
σ0.000
min2843.000-2867.000=-24.000
max2843.000-2867.000=-24.000
mean2.962-2.940=0.023
σ0.026-0.011=0.015
min2.936-2.929=0.007
max2.995-2.951=0.044
policies=200
mean18546.759-18519.766=26.993
σ0.448-0.853=-0.405
min18546.477-18519.038=27.440
max18547.428-18520.749=26.680
mean8400.000
σ0.000
min8400.000
max8400.000
mean2843.000-2867.000=-24.000
σ0.000
min2843.000-2867.000=-24.000
max2843.000-2867.000=-24.000
mean29.283-29.133=0.150
σ0.455-0.472=-0.017
min28.888-28.783=0.104
max29.804-29.799=0.005