Compare commits

Home / Compare d4413c5d .. 8720c340

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.824=-0.002
σ0.368-0.367=0.000
min53.680-53.681=-0.000
max54.868-54.869=-0.001
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.136-0.139=-0.003
σ0.005-0.003=0.001
min0.131-0.136=-0.005
max0.143-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.008-0.007=0.001
min43.194-43.198=-0.004
max43.224-43.221=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.119-0.122=-0.002
σ0.005-0.003=0.001
min0.114-0.118=-0.004
max0.129-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.174-1016.176=-0.002
σ1.178-1.172=0.006
min1015.619-1015.624=-0.004
max1021.108-1021.085=0.023
mean1045.900-1048.550=-2.650
σ312.228-311.916=0.312
min553.000-557.000=-4.000
max1512.000-1515.000=-3.000
mean1.574-1.543=0.031
σ0.062-0.068=-0.005
min1.499-1.375=0.125
max1.708-1.680=0.027

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.400-301.364=0.036
σ0.239-0.232=0.007
min301.224-301.187=0.037
max302.049-301.966=0.083
mean2030.000-2016.000=14.000
σ0.000
min2030.000-2016.000=14.000
max2030.000-2016.000=14.000
mean0.604-0.556=0.047
σ0.008-0.038=-0.030
min0.583-0.507=0.076
max0.610-0.601=0.009

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.695-300.704=-0.010
σ0.025-0.021=0.004
min300.656-300.678=-0.022
max300.719-300.736=-0.017
mean1512.000-1515.000=-3.000
σ0.000
min1512.000-1515.000=-3.000
max1512.000-1515.000=-3.000
mean0.399-0.395=0.004
σ0.010-0.006=0.005
min0.388-0.389=-0.001
max0.409-0.401=0.008
iters=5
new-facts=1
prior-facts=6402
mean1322.863-1322.863=-0.000
σ0.087-0.087=-0.001
min1322.816-1322.817=-0.001
max1323.017-1323.019=-0.002
mean1512.000-1515.000=-3.000
σ0.000
min1512.000-1515.000=-3.000
max1512.000-1515.000=-3.000
mean1.896-1.887=0.009
σ0.079-0.053=0.026
min1.816-1.824=-0.009
max1.977-1.931=0.046
iters=5
new-facts=6402
prior-facts=1
mean1561.321-1561.322=-0.002
σ6.875-6.883=-0.008
min1558.024-1558.038=-0.014
max1573.614-1573.631=-0.017
mean1512.000-1515.000=-3.000
σ0.000
min1512.000-1515.000=-3.000
max1512.000-1515.000=-3.000
mean2.352-2.357=-0.005
σ0.325-0.361=-0.036
min2.034-2.036=-0.003
max2.702-2.773=-0.071
iters=5
new-facts=6402
prior-facts=6402
mean1890.797-1890.795=0.002
σ0.022-0.024=-0.002
min1890.767-1890.765=0.001
max1890.825-1890.829=-0.004
mean1729.600-1724.400=5.200
σ213.012-206.599=6.413
min1512.000-1515.000=-3.000
max2030.000-2016.000=14.000
mean3.001-2.940=0.062
σ0.359-0.122=0.236
min2.724-2.865=-0.141
max3.630-3.157=0.473

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.561-1.610=-0.049
σ0.323-0.264=0.058
min1.206-1.194=0.013
max1.853-1.815=0.038

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.034-443.034=0.001
σ573.400-573.402=-0.001
min156.332-156.332=0.000
max1303.135-1303.136=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1512.000-1515.000=-3.000
σ0.000
min1512.000-1515.000=-3.000
max1512.000-1515.000=-3.000
mean0.549-0.536=0.013
σ0.569-0.545=0.024
min0.260-0.258=0.002
max1.403-1.353=0.049
policies=20
mean1563.586-1563.588=-0.002
σ0.319-0.342=-0.022
min1563.381-1563.377=0.005
max1564.063-1564.098=-0.036
mean920.000
σ0.000
min920.000
max920.000
mean1512.000-1515.000=-3.000
σ0.000
min1512.000-1515.000=-3.000
max1512.000-1515.000=-3.000
mean2.636-2.624=0.012
σ0.008-0.009=-0.001
min2.628-2.611=0.017
max2.645-2.631=0.013
policies=200
mean15643.940-15643.941=-0.001
σ0.023-0.100=-0.077
min15643.924-15643.814=0.110
max15643.974-15644.046=-0.072
mean9200.000
σ0.000
min9200.000
max9200.000
mean1512.000-1515.000=-3.000
σ0.000
min1512.000-1515.000=-3.000
max1512.000-1515.000=-3.000
mean26.540-26.559=-0.018
σ0.113-0.158=-0.045
min26.475-26.396=0.079
max26.710-26.723=-0.013