Compare commits

Home / Compare c121c7f8 .. 37dd7f1e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.379-70.379=0.000
σ0.048-0.048=-0.000
min70.350-70.353=-0.002
max70.512-70.514=-0.001
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.158-0.160=-0.002
σ0.002-0.003=-0.001
min0.156-0.158=-0.002
max0.162-0.165=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.002=-0.000
min21.142-21.140=0.002
max21.148-21.148=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.066-0.060=0.006
σ0.003-0.003=-0.000
min0.064-0.058=0.006
max0.075-0.068=0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.385-1752.388=-0.003
σ0.361-0.361=-0.000
min1751.819-1751.812=0.007
max1752.969-1752.982=-0.013
mean1635.050-1631.100=3.950
σ602.760-597.689=5.071
min668.000-624.000=44.000
max2454.000-2412.000=42.000
mean2.750-2.784=-0.033
σ0.232-0.204=0.028
min2.322-2.181=0.141
max3.057-3.015=0.042

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.124-270.128=-0.004
σ0.006-0.004=0.002
min270.118-270.123=-0.006
max270.134-270.132=0.002
mean2454.000-2412.000=42.000
σ0.000
min2454.000-2412.000=42.000
max2454.000-2412.000=42.000
mean0.373-0.382=-0.009
σ0.004-0.003=0.001
min0.371-0.380=-0.009
max0.380-0.388=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1930.589-1930.590=-0.001
σ0.025-0.010=0.015
min1930.551-1930.577=-0.026
max1930.615-1930.601=0.015
mean2454.000-2412.000=42.000
σ0.000
min2454.000-2412.000=42.000
max2454.000-2412.000=42.000
mean2.557-2.525=0.032
σ0.096-0.124=-0.027
min2.464-2.455=0.009
max2.681-2.744=-0.064
iters=5
new-facts=6402
prior-facts=1
mean4751.123-4751.102=0.021
σ0.780-0.876=-0.095
min4750.651-4750.628=0.022
max4752.509-4752.661=-0.152
mean2454.000-2412.000=42.000
σ0.000
min2454.000-2412.000=42.000
max2454.000-2412.000=42.000
mean8.064-8.381=-0.317
σ0.396-0.712=-0.316
min7.676-7.626=0.050
max8.517-9.149=-0.632
iters=5
new-facts=6402
prior-facts=6402
mean4941.526-4941.531=-0.005
σ0.089-0.091=-0.003
min4941.451-4941.456=-0.006
max4941.629-4941.636=-0.007
mean2900.200-3021.400=-121.200
σ394.471-327.001=67.470
min2454.000-2571.000=-117.000
max3427.000-3322.000=105.000
mean8.455-8.774=-0.319
σ0.126-0.234=-0.109
min8.345-8.555=-0.211
max8.619-9.084=-0.464

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.722-1.861=-0.139
σ0.140-0.091=0.049
min1.541-1.712=-0.171
max1.923-1.948=-0.026

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-466.361=0.004
σ575.935-575.937=-0.002
min178.393-178.389=0.004
max1330.266-1330.266=0.001
mean84.000
σ8.000
min80.000
max96.000
mean2454.000-2412.000=42.000
σ0.000
min2454.000-2412.000=42.000
max2454.000-2412.000=42.000
mean0.550-0.547=0.003
σ0.539-0.528=0.011
min0.276-0.275=0.001
max1.358-1.338=0.020
policies=20
mean1784.213-1784.219=-0.006
σ0.361-0.355=0.006
min1783.981-1783.984=-0.004
max1784.750-1784.746=0.005
mean800.000
σ0.000
min800.000
max800.000
mean2454.000-2412.000=42.000
σ0.000
min2454.000-2412.000=42.000
max2454.000-2412.000=42.000
mean2.763-2.801=-0.038
σ0.012-0.053=-0.040
min2.745-2.752=-0.007
max2.772-2.874=-0.102
policies=200
mean17848.862-17848.643=0.219
σ0.483-0.396=0.087
min17848.600-17848.317=0.283
max17849.585-17849.216=0.369
mean8000.000
σ0.000
min8000.000
max8000.000
mean2454.000-2412.000=42.000
σ0.000
min2454.000-2412.000=42.000
max2454.000-2412.000=42.000
mean27.959-27.969=-0.010
σ0.093-0.210=-0.117
min27.853-27.823=0.030
max28.078-28.281=-0.203