Compare commits

Home / Compare 666cc875 .. fdf1c4c6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.973-53.971=0.002
σ0.370-0.368=0.002
min53.834-53.825=0.008
max55.027-55.019=0.007
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.141-0.139=0.003
σ0.010-0.004=0.005
min0.135-0.131=0.004
max0.167-0.146=0.021
cache=y
dps=1
iters=10
policies=100
mean43.342-43.343=-0.002
σ0.007-0.006=0.000
min43.334-43.332=0.002
max43.356-43.356=0.000
mean417.000-419.000=-2.000
σ0.000
min417.000-419.000=-2.000
max417.000-419.000=-2.000
mean0.118-0.123=-0.004
σ0.003-0.004=-0.001
min0.112-0.119=-0.007
max0.121-0.129=-0.008

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.894-1016.900=-0.007
σ1.154-1.146=0.008
min1016.322-1016.319=0.003
max1021.728-1021.684=0.044
mean1058.000-1048.950=9.050
σ310.965-300.037=10.929
min589.000-579.000=10.000
max1617.000-1468.000=149.000
mean1.511-1.533=-0.022
σ0.055-0.108=-0.053
min1.418-1.423=-0.004
max1.628-1.900=-0.271

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.027-302.032=-0.005
σ0.251-0.243=0.008
min301.874-301.872=0.002
max302.725-302.699=0.026
mean2048.000-1946.000=102.000
σ0.000
min2048.000-1946.000=102.000
max2048.000-1946.000=102.000
mean0.602-0.596=0.006
σ0.009-0.020=-0.011
min0.582-0.542=0.040
max0.613-0.611=0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.521-303.511=0.010
σ0.039-0.062=-0.023
min303.478-303.412=0.067
max303.569-303.572=-0.003
mean1617.000-1468.000=149.000
σ0.000
min1617.000-1468.000=149.000
max1617.000-1468.000=149.000
mean0.389-0.395=-0.005
σ0.000-0.011=-0.010
min0.389-0.386=0.003
max0.390-0.412=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1326.060-1326.051=0.009
σ0.111-0.105=0.006
min1325.925-1325.921=0.003
max1326.203-1326.204=-0.001
mean1617.000-1468.000=149.000
σ0.000
min1617.000-1468.000=149.000
max1617.000-1468.000=149.000
mean1.930-1.962=-0.032
σ0.077-0.134=-0.058
min1.842-1.848=-0.006
max2.005-2.191=-0.186
iters=5
new-facts=6402
prior-facts=1
mean1564.104-1564.130=-0.025
σ6.920-6.930=-0.010
min1560.771-1560.790=-0.019
max1576.477-1576.520=-0.043
mean1617.000-1468.000=149.000
σ0.000
min1617.000-1468.000=149.000
max1617.000-1468.000=149.000
mean2.263-2.385=-0.122
σ0.246-0.307=-0.061
min2.129-2.096=0.033
max2.698-2.861=-0.164
iters=5
new-facts=6402
prior-facts=6402
mean1894.002-1893.990=0.012
σ0.074-0.076=-0.002
min1893.871-1893.881=-0.010
max1894.043-1894.050=-0.007
mean1768.200-1755.200=13.000
σ180.421-150.966=29.455
min1617.000-1526.000=91.000
max2048.000-1946.000=102.000
mean2.996-3.130=-0.134
σ0.227-0.394=-0.166
min2.737-2.842=-0.105
max3.345-3.797=-0.451

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.268-1.699=-0.431
σ0.276-0.125=0.151
min1.051-1.537=-0.486
max1.729-1.809=-0.080

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.710-444.488=0.223
σ575.146-574.724=0.422
min157.135-157.123=0.012
max1307.430-1306.574=0.856
mean96.250
σ8.500
min92.000
max109.000
mean1617.000-1468.000=149.000
σ0.000
min1617.000-1468.000=149.000
max1617.000-1468.000=149.000
mean0.534-0.541=-0.006
σ0.534-0.551=-0.017
min0.263-0.264=-0.000
max1.335-1.367=-0.032
policies=20
mean1571.555-1571.521=0.033
σ0.345-0.333=0.012
min1571.346-1571.299=0.046
max1572.070-1572.018=0.053
mean920.000
σ0.000
min920.000
max920.000
mean1617.000-1468.000=149.000
σ0.000
min1617.000-1468.000=149.000
max1617.000-1468.000=149.000
mean2.635-2.606=0.030
σ0.014-0.012=0.002
min2.617-2.591=0.027
max2.652-2.621=0.031
policies=200
mean15723.336-15723.329=0.007
σ0.089-0.110=-0.021
min15723.238-15723.184=0.054
max15723.453-15723.446=0.007
mean9200.000
σ0.000
min9200.000
max9200.000
mean1617.000-1468.000=149.000
σ0.000
min1617.000-1468.000=149.000
max1617.000-1468.000=149.000
mean26.576-26.418=0.158
σ0.081-0.163=-0.083
min26.480-26.242=0.237
max26.674-26.623=0.051