Compare commits

Home / Compare 6b25e409 .. a2e0fd0b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.822-53.653=0.170
σ0.368-0.366=0.002
min53.684-53.511=0.173
max54.871-54.695=0.176
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.136-0.138=-0.002
σ0.004-0.004=0.000
min0.130-0.129=0.001
max0.143-0.145=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-42.981=0.227
σ0.007-0.005=0.002
min43.198-42.975=0.223
max43.220-42.990=0.230
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.121-0.121=0.001
σ0.004-0.004=-0.000
min0.118-0.117=0.001
max0.127-0.127=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.182-1013.978=2.204
σ1.153-1.173=-0.020
min1015.604-1013.409=2.195
max1020.998-1018.887=2.111
mean1039.650-1063.200=-23.550
σ305.121-323.677=-18.556
min584.000-553.000=31.000
max1652.000-1534.000=118.000
mean1.572-1.632=-0.060
σ0.100-0.068=0.032
min1.482-1.554=-0.072
max1.848-1.768=0.080

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.326-299.250=2.076
σ0.166-0.233=-0.067
min301.193-299.029=2.164
max301.782-299.862=1.920
mean1951.000-1911.000=40.000
σ0.000
min1951.000-1911.000=40.000
max1951.000-1911.000=40.000
mean0.550-0.593=-0.044
σ0.039-0.041=-0.002
min0.500-0.537=-0.037
max0.586-0.692=-0.105

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.701-294.681=6.019
σ0.022-0.020=0.002
min300.667-294.656=6.012
max300.727-294.707=6.019
mean1652.000-1534.000=118.000
σ0.000
min1652.000-1534.000=118.000
max1652.000-1534.000=118.000
mean0.396-0.386=0.009
σ0.008-0.007=0.001
min0.387-0.380=0.007
max0.406-0.395=0.011
iters=5
new-facts=1
prior-facts=6402
mean1322.871-1316.930=5.941
σ0.097-0.112=-0.015
min1322.798-1316.844=5.954
max1323.022-1317.126=5.895
mean1652.000-1534.000=118.000
σ0.000
min1652.000-1534.000=118.000
max1652.000-1534.000=118.000
mean1.940-2.022=-0.082
σ0.095-0.115=-0.020
min1.838-1.932=-0.094
max2.077-2.221=-0.144
iters=5
new-facts=6402
prior-facts=1
mean1561.311-1555.321=5.991
σ6.899-6.824=0.075
min1557.987-1552.029=5.958
max1573.647-1567.522=6.124
mean1652.000-1534.000=118.000
σ0.000
min1652.000-1534.000=118.000
max1652.000-1534.000=118.000
mean2.349-2.372=-0.023
σ0.345-0.144=0.201
min2.137-2.204=-0.067
max2.958-2.576=0.382
iters=5
new-facts=6402
prior-facts=6402
mean1890.799-1884.775=6.024
σ0.031-0.038=-0.007
min1890.780-1884.750=6.030
max1890.853-1884.840=6.013
mean1786.400-1742.600=43.800
σ111.498-171.048=-59.550
min1652.000-1534.000=118.000
max1951.000-1911.000=40.000
mean2.975-3.095=-0.120
σ0.189-0.281=-0.092
min2.846-2.896=-0.050
max3.304-3.590=-0.286

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.074-1.504=-0.429
σ0.162-0.293=-0.131
min0.918-1.085=-0.167
max1.257-1.808=-0.551

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.339-440.671=2.668
σ573.984-573.409=0.575
min156.333-153.965=2.368
max1304.315-1300.784=3.530
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1534.000=118.000
σ0.000
min1652.000-1534.000=118.000
max1652.000-1534.000=118.000
mean0.530-0.536=-0.006
σ0.541-0.549=-0.009
min0.258-0.259=-0.001
max1.341-1.360=-0.019
policies=20
mean1563.639-1539.895=23.745
σ0.321-0.314=0.008
min1563.462-1539.709=23.754
max1564.121-1540.364=23.757
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1534.000=118.000
σ0.000
min1652.000-1534.000=118.000
max1652.000-1534.000=118.000
mean2.616-2.591=0.025
σ0.019-0.016=0.003
min2.592-2.575=0.017
max2.637-2.612=0.025
policies=200
mean15644.170-15407.070=237.100
σ0.064-0.081=-0.017
min15644.102-15406.978=237.124
max15644.253-15407.172=237.081
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1534.000=118.000
σ0.000
min1652.000-1534.000=118.000
max1652.000-1534.000=118.000
mean26.514-26.363=0.151
σ0.178-0.203=-0.025
min26.349-26.165=0.183
max26.747-26.587=0.160