Compare commits

Home / Compare 15137a00 .. 749731a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.047-0.046=0.001
min70.755-70.756=-0.001
max70.914-70.911=0.003
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.161-0.157=0.004
σ0.003-0.005=-0.002
min0.158-0.150=0.008
max0.166-0.165=0.002
cache=y
dps=1
iters=10
policies=100
mean21.492-21.494=-0.002
σ0.002-0.002=0.000
min21.490-21.492=-0.002
max21.496-21.497=-0.001
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.065=-0.002
σ0.004-0.002=0.001
min0.059-0.063=-0.004
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.094-1754.096=-0.001
σ0.362-0.361=0.001
min1753.522-1753.533=-0.011
max1754.676-1754.690=-0.014
mean1665.550-1654.150=11.400
σ632.140-631.469=0.671
min671.000-624.000=47.000
max2621.000-2704.000=-83.000
mean2.685-2.760=-0.075
σ0.254-0.263=-0.008
min2.250-2.268=-0.018
max3.109-3.088=0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.593-271.597=-0.004
σ0.009-0.007=0.002
min271.587-271.587=-0.001
max271.608-271.604=0.004
mean2621.000-2704.000=-83.000
σ0.000
min2621.000-2704.000=-83.000
max2621.000-2704.000=-83.000
mean0.379-0.382=-0.004
σ0.001-0.004=-0.003
min0.377-0.378=-0.001
max0.379-0.387=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1932.003-1931.995=0.008
σ0.010-0.018=-0.007
min1931.992-1931.965=0.027
max1932.015-1932.008=0.008
mean2621.000-2704.000=-83.000
σ0.000
min2621.000-2704.000=-83.000
max2621.000-2704.000=-83.000
mean2.524-2.531=-0.008
σ0.072-0.087=-0.015
min2.455-2.456=-0.000
max2.638-2.646=-0.008
iters=5
new-facts=6402
prior-facts=1
mean4752.780-4752.739=0.041
σ0.841-0.926=-0.085
min4752.248-4752.192=0.056
max4754.270-4754.366=-0.095
mean2621.000-2704.000=-83.000
σ0.000
min2621.000-2704.000=-83.000
max2621.000-2704.000=-83.000
mean8.313-8.872=-0.560
σ0.505-0.642=-0.137
min7.636-8.275=-0.639
max8.940-9.880=-0.940
iters=5
new-facts=6402
prior-facts=6402
mean4943.137-4943.207=-0.070
σ0.148-0.017=0.132
min4942.873-4943.188=-0.315
max4943.221-4943.222=-0.001
mean3010.200-2974.600=35.600
σ292.275-233.116=59.159
min2621.000-2704.000=-83.000
max3384.000-3302.000=82.000
mean8.471-8.636=-0.165
σ0.092-0.251=-0.159
min8.332-8.443=-0.112
max8.559-9.066=-0.507

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.303-1.015=0.288
σ0.293-0.135=0.158
min1.065-0.925=0.141
max1.762-1.235=0.526

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.608-468.615=-0.007
σ574.886-574.890=-0.005
min181.165-181.169=-0.005
max1330.936-1330.951=-0.014
mean88.250
σ8.500
min84.000
max101.000
mean2621.000-2704.000=-83.000
σ0.000
min2621.000-2704.000=-83.000
max2621.000-2704.000=-83.000
mean0.562-0.545=0.018
σ0.523-0.527=-0.003
min0.290-0.270=0.020
max1.347-1.334=0.013
policies=20
mean1811.926-1811.953=-0.028
σ0.381-0.376=0.005
min1811.668-1811.699=-0.032
max1812.489-1812.510=-0.021
mean840.000
σ0.000
min840.000
max840.000
mean2621.000-2704.000=-83.000
σ0.000
min2621.000-2704.000=-83.000
max2621.000-2704.000=-83.000
mean2.817-2.839=-0.022
σ0.016-0.013=0.003
min2.795-2.826=-0.030
max2.832-2.856=-0.024
policies=200
mean18126.662-18126.707=-0.045
σ0.417-0.457=-0.040
min18126.301-18126.405=-0.104
max18127.263-18127.385=-0.122
mean8400.000
σ0.000
min8400.000
max8400.000
mean2621.000-2704.000=-83.000
σ0.000
min2621.000-2704.000=-83.000
max2621.000-2704.000=-83.000
mean28.546-28.609=-0.063
σ0.277-0.183=0.094
min28.325-28.461=-0.136
max28.947-28.876=0.072