Compare commits

Home / Compare faa40762 .. 9149f222

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.655=-0.001
σ0.367-0.369=-0.003
min53.516-53.509=0.008
max54.697-54.705=-0.008
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.136-0.131=0.005
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.981-42.980=0.001
σ0.006-0.005=0.001
min42.974-42.972=0.002
max42.988-42.987=0.001
mean418.000-411.000=7.000
σ0.000
min418.000-411.000=7.000
max418.000-411.000=7.000
mean0.121-0.119=0.002
σ0.003-0.005=-0.002
min0.118-0.113=0.005
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.975-1013.695=0.280
σ1.156-1.233=-0.077
min1013.419-1013.095=0.325
max1018.808-1018.856=-0.049
mean1046.800-1047.700=-0.900
σ319.033-312.782=6.252
min586.000-606.000=-20.000
max1653.000-1648.000=5.000
mean1.648-1.624=0.024
σ0.104-0.083=0.022
min1.564-1.454=0.110
max1.957-1.852=0.106

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.123-334.219=-35.096
σ0.201-0.240=-0.039
min298.949-334.037=-35.088
max299.655-334.874=-35.219
mean1969.000-2008.000=-39.000
σ0.000
min1969.000-2008.000=-39.000
max1969.000-2008.000=-39.000
mean0.602-0.819=-0.217
σ0.031-0.046=-0.015
min0.555-0.713=-0.158
max0.626-0.859=-0.233

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.675-294.414=0.261
σ0.018-0.012=0.006
min294.658-294.397=0.261
max294.702-294.430=0.271
mean1653.000-1648.000=5.000
σ0.000
min1653.000-1648.000=5.000
max1653.000-1648.000=5.000
mean0.387-0.381=0.006
σ0.009-0.002=0.007
min0.381-0.379=0.002
max0.403-0.382=0.020
iters=5
new-facts=1
prior-facts=6402
mean1316.963-1316.703=0.260
σ0.093-0.083=0.011
min1316.888-1316.566=0.322
max1317.112-1316.764=0.347
mean1653.000-1648.000=5.000
σ0.000
min1653.000-1648.000=5.000
max1653.000-1648.000=5.000
mean1.972-1.929=0.043
σ0.117-0.055=0.062
min1.858-1.844=0.015
max2.138-1.985=0.153
iters=5
new-facts=6402
prior-facts=1
mean1555.300-1736.966=-181.666
σ6.893-6.894=-0.001
min1551.973-1733.786=-181.813
max1567.624-1749.297=-181.673
mean1653.000-1648.000=5.000
σ0.000
min1653.000-1648.000=5.000
max1653.000-1648.000=5.000
mean2.360-2.934=-0.574
σ0.339-0.341=-0.002
min1.988-2.636=-0.648
max2.852-3.478=-0.627
iters=5
new-facts=6402
prior-facts=6402
mean1884.777-1999.628=-114.851
σ0.028-0.047=-0.018
min1884.759-1999.554=-114.795
max1884.826-1999.668=-114.842
mean1778.200-1801.600=-23.400
σ131.843-154.003=-22.159
min1653.000-1648.000=5.000
max1969.000-2008.000=-39.000
mean2.961-3.380=-0.420
σ0.093-0.358=-0.265
min2.869-3.144=-0.275
max3.096-3.998=-0.902

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.162-1.150=0.012
σ0.367-0.265=0.102
min0.911-0.904=0.008
max1.784-1.575=0.209

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.571-441.085=-0.515
σ573.032-573.035=-0.003
min154.044-154.566=-0.522
max1300.119-1300.637=-0.519
mean96.250-94.250=2.000
σ8.500
min92.000-90.000=2.000
max109.000-107.000=2.000
mean1653.000-1648.000=5.000
σ0.000
min1653.000-1648.000=5.000
max1653.000-1648.000=5.000
mean0.546-0.539=0.007
σ0.542-0.556=-0.014
min0.271-0.257=0.014
max1.359-1.374=-0.015
policies=20
mean1540.692-1545.914=-5.221
σ0.319-0.333=-0.014
min1540.498-1545.720=-5.222
max1541.169-1546.412=-5.243
mean920.000-900.000=20.000
σ0.000
min920.000-900.000=20.000
max920.000-900.000=20.000
mean1653.000-1648.000=5.000
σ0.000
min1653.000-1648.000=5.000
max1653.000-1648.000=5.000
mean2.599-2.624=-0.025
σ0.013-0.013=-0.000
min2.588-2.605=-0.017
max2.616-2.636=-0.020
policies=200
mean15414.750-15467.047=-52.298
σ0.089-0.105=-0.016
min15414.651-15466.939=-52.288
max15414.852-15467.144=-52.292
mean9200.000-9000.000=200.000
σ0.000
min9200.000-9000.000=200.000
max9200.000-9000.000=200.000
mean1653.000-1648.000=5.000
σ0.000
min1653.000-1648.000=5.000
max1653.000-1648.000=5.000
mean26.291-26.683=-0.392
σ0.236-0.141=0.095
min26.060-26.542=-0.483
max26.536-26.823=-0.286