Compare commits

Home / Compare cf618c0e .. 2acd9103

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.388-70.390=-0.002
σ0.045-0.047=-0.002
min70.359-70.359=-0.000
max70.514-70.520=-0.006
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.160-0.162=-0.002
σ0.003-0.002=0.001
min0.157-0.159=-0.002
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.002=-0.000
min21.142-21.141=0.001
max21.149-21.148=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.060=0.003
max0.070-0.070=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.699-1752.699=0.000
σ0.361-0.359=0.001
min1752.126-1752.126=-0.000
max1753.282-1753.290=-0.008
mean1658.150-1653.550=4.600
σ638.278-643.853=-5.575
min687.000-631.000=56.000
max2769.000-2859.000=-90.000
mean2.776-2.788=-0.012
σ0.184-0.214=-0.030
min2.399-2.169=0.230
max3.179-3.037=0.142

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.514-270.517=-0.003
σ0.006-0.005=0.001
min270.507-270.509=-0.002
max270.519-270.522=-0.003
mean2769.000-2859.000=-90.000
σ0.000
min2769.000-2859.000=-90.000
max2769.000-2859.000=-90.000
mean0.383-0.381=0.001
σ0.010-0.006=0.003
min0.375-0.378=-0.003
max0.396-0.392=0.004
iters=5
new-facts=1
prior-facts=6402
mean1930.947-1930.949=-0.002
σ0.003-0.009=-0.006
min1930.944-1930.933=0.011
max1930.952-1930.956=-0.004
mean2769.000-2859.000=-90.000
σ0.000
min2769.000-2859.000=-90.000
max2769.000-2859.000=-90.000
mean2.965-3.051=-0.086
σ0.224-0.218=0.006
min2.603-2.716=-0.113
max3.179-3.283=-0.104
iters=5
new-facts=6402
prior-facts=1
mean4751.324-4751.721=-0.396
σ0.793-0.835=-0.041
min4750.734-4751.141=-0.408
max4752.701-4753.193=-0.491
mean2769.000-2859.000=-90.000
σ0.000
min2769.000-2859.000=-90.000
max2769.000-2859.000=-90.000
mean8.477-8.294=0.183
σ0.720-0.524=0.197
min7.545-7.765=-0.219
max9.215-9.107=0.108
iters=5
new-facts=6402
prior-facts=6402
mean4942.069-4942.144=-0.075
σ0.155-0.031=0.123
min4941.794-4942.102=-0.308
max4942.154-4942.172=-0.018
mean3033.800-3038.200=-4.400
σ323.556-249.866=73.690
min2769.000-2859.000=-90.000
max3520.000-3429.000=91.000
mean8.496-8.551=-0.055
σ0.141-0.351=-0.211
min8.322-8.267=0.055
max8.655-9.141=-0.486

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.018-1.035=-0.017
σ0.134-0.136=-0.002
min0.928-0.938=-0.009
max1.236-1.256=-0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.827-466.826=0.001
σ575.926-575.927=-0.001
min178.859-178.858=0.001
max1330.716-1330.716=-0.000
mean84.000
σ8.000
min80.000
max96.000
mean2769.000-2859.000=-90.000
σ0.000
min2769.000-2859.000=-90.000
max2769.000-2859.000=-90.000
mean0.438-0.442=-0.004
σ0.300-0.299=0.001
min0.285-0.291=-0.006
max0.888-0.891=-0.003
policies=20
mean1788.841-1788.834=0.007
σ0.320-0.354=-0.034
min1788.640-1788.586=0.053
max1789.312-1789.354=-0.042
mean800.000
σ0.000
min800.000
max800.000
mean2769.000-2859.000=-90.000
σ0.000
min2769.000-2859.000=-90.000
max2769.000-2859.000=-90.000
mean2.800-2.887=-0.088
σ0.064-0.045=0.019
min2.755-2.863=-0.108
max2.894-2.954=-0.060
policies=200
mean17894.777-17894.756=0.021
σ0.452-0.484=-0.033
min17894.505-17894.433=0.073
max17895.452-17895.477=-0.025
mean8000.000
σ0.000
min8000.000
max8000.000
mean2769.000-2859.000=-90.000
σ0.000
min2769.000-2859.000=-90.000
max2769.000-2859.000=-90.000
mean27.895-28.493=-0.599
σ0.121-0.484=-0.363
min27.775-27.984=-0.209
max28.021-28.968=-0.947