Compare commits

Home / Compare e6166032 .. 940e7bdd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.654-53.654=0.000
σ0.368-0.366=0.002
min53.517-53.516=0.001
max54.701-54.695=0.006
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.136-0.139=-0.002
σ0.005-0.004=0.000
min0.129-0.135=-0.006
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=0.001
σ0.006-0.006=0.000
min42.973-42.974=-0.000
max42.993-42.992=0.001
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.119-0.120=-0.001
σ0.004-0.003=0.001
min0.113-0.117=-0.005
max0.126-0.126=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.976-1013.974=0.002
σ1.170-1.168=0.002
min1013.436-1013.418=0.017
max1018.870-1018.861=0.009
mean1049.750-1048.900=0.850
σ317.025-316.661=0.364
min585.000-584.000=1.000
max1652.000-1651.000=1.000
mean1.618-1.619=-0.002
σ0.074-0.080=-0.006
min1.492-1.489=0.003
max1.813-1.869=-0.056

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.401-299.047=0.354
σ0.214-0.245=-0.031
min299.258-298.899=0.359
max299.996-299.735=0.262
mean1969.000-2045.000=-76.000
σ0.000
min1969.000-2045.000=-76.000
max1969.000-2045.000=-76.000
mean0.583-0.574=0.009
σ0.025-0.024=0.001
min0.536-0.544=-0.009
max0.616-0.613=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.681-294.679=0.002
σ0.015-0.016=-0.001
min294.659-294.658=0.000
max294.702-294.700=0.001
mean1652.000-1651.000=1.000
σ0.000
min1652.000-1651.000=1.000
max1652.000-1651.000=1.000
mean0.383-0.383=-0.000
σ0.002-0.007=-0.005
min0.381-0.374=0.007
max0.386-0.393=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1316.950-1316.937=0.012
σ0.094-0.104=-0.011
min1316.876-1316.883=-0.007
max1317.112-1317.124=-0.012
mean1652.000-1651.000=1.000
σ0.000
min1652.000-1651.000=1.000
max1652.000-1651.000=1.000
mean1.959-1.930=0.029
σ0.081-0.063=0.017
min1.845-1.853=-0.008
max2.055-2.008=0.047
iters=5
new-facts=6402
prior-facts=1
mean1555.290-1555.297=-0.008
σ6.869-6.878=-0.009
min1551.959-1551.944=0.015
max1567.571-1567.594=-0.022
mean1652.000-1651.000=1.000
σ0.000
min1652.000-1651.000=1.000
max1652.000-1651.000=1.000
mean2.262-2.374=-0.112
σ0.195-0.323=-0.127
min2.124-2.116=0.008
max2.599-2.851=-0.252
iters=5
new-facts=6402
prior-facts=6402
mean1884.781-1884.773=0.008
σ0.023-0.036=-0.013
min1884.767-1884.742=0.025
max1884.822-1884.835=-0.013
mean1777.800-1789.600=-11.800
σ132.319-170.449=-38.130
min1652.000-1651.000=1.000
max1969.000-2045.000=-76.000
mean2.946-2.963=-0.018
σ0.083-0.077=0.006
min2.841-2.892=-0.050
max3.050-3.071=-0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.190=0.023
σ0.307-0.335=-0.028
min0.998-0.917=0.081
max1.739-1.753=-0.014

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.679-440.569=0.109
σ573.411-573.034=0.378
min153.965-154.048=-0.083
max1300.796-1300.120=0.676
mean96.250
σ8.500
min92.000
max109.000
mean1652.000-1651.000=1.000
σ0.000
min1652.000-1651.000=1.000
max1652.000-1651.000=1.000
mean0.544-0.548=-0.004
σ0.546-0.545=0.001
min0.269-0.274=-0.005
max1.363-1.365=-0.003
policies=20
mean1539.906-1540.696=-0.790
σ0.327-0.313=0.014
min1539.722-1540.517=-0.794
max1540.396-1541.165=-0.770
mean920.000
σ0.000
min920.000
max920.000
mean1652.000-1651.000=1.000
σ0.000
min1652.000-1651.000=1.000
max1652.000-1651.000=1.000
mean2.615-2.595=0.020
σ0.056-0.010=0.046
min2.585-2.584=0.002
max2.699-2.607=0.092
policies=200
mean15406.849-15414.801=-7.952
σ0.280-0.123=0.157
min15406.458-15414.677=-8.219
max15407.114-15414.953=-7.839
mean9200.000
σ0.000
min9200.000
max9200.000
mean1652.000-1651.000=1.000
σ0.000
min1652.000-1651.000=1.000
max1652.000-1651.000=1.000
mean26.238-26.186=0.053
σ0.203-0.132=0.071
min26.021-26.051=-0.030
max26.418-26.346=0.071