Compare commits

Home / Compare 394bd661 .. 2de1a3e9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.048-53.837=0.211
σ0.371-0.366=0.005
min53.906-53.701=0.205
max55.103-54.878=0.225
mean416.000-417.700=-1.700
σ0.000-0.483=-0.483
min416.000-417.000=-1.000
max416.000-418.000=-2.000
mean0.138-0.136=0.001
σ0.005-0.004=0.001
min0.131-0.129=0.002
max0.146-0.143=0.003
cache=y
dps=1
iters=10
policies=100
mean43.340-43.208=0.132
σ0.010-0.007=0.003
min43.323-43.198=0.125
max43.354-43.221=0.133
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.115-0.119=-0.004
σ0.017-0.001=0.016
min0.081-0.117=-0.036
max0.129-0.121=0.009

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.195-1016.202=0.993
σ1.157-1.240=-0.083
min1016.619-1015.661=0.959
max1022.035-1021.404=0.631
mean1057.550-1051.750=5.800
σ313.312-306.067=7.245
min563.000-555.000=8.000
max1518.000-1454.000=64.000
mean1.524-1.590=-0.066
σ0.059-0.156=-0.097
min1.455-1.494=-0.039
max1.614-2.174=-0.561

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.970-301.146=0.825
σ0.195-0.208=-0.013
min301.823-301.003=0.820
max302.479-301.721=0.759
mean2046.000-1913.000=133.000
σ0.000
min2046.000-1913.000=133.000
max2046.000-1913.000=133.000
mean0.600-0.572=0.027
σ0.009-0.042=-0.034
min0.587-0.517=0.070
max0.610-0.647=-0.038

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.779-301.480=2.300
σ0.059-0.045=0.014
min303.684-301.408=2.276
max303.836-301.523=2.313
mean1518.000-1454.000=64.000
σ0.000
min1518.000-1454.000=64.000
max1518.000-1454.000=64.000
mean0.392-0.394=-0.002
σ0.001-0.009=-0.008
min0.391-0.386=0.005
max0.393-0.407=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1326.329-1324.049=2.280
σ0.104-0.104=0.000
min1326.198-1323.945=2.253
max1326.454-1324.211=2.243
mean1518.000-1454.000=64.000
σ0.000
min1518.000-1454.000=64.000
max1518.000-1454.000=64.000
mean1.937-1.920=0.018
σ0.066-0.065=0.001
min1.876-1.840=0.036
max2.013-1.976=0.037
iters=5
new-facts=6402
prior-facts=1
mean1564.397-1562.095=2.302
σ6.883-6.900=-0.017
min1561.121-1558.765=2.356
max1576.706-1574.433=2.272
mean1518.000-1454.000=64.000
σ0.000
min1518.000-1454.000=64.000
max1518.000-1454.000=64.000
mean2.314-2.388=-0.074
σ0.255-0.215=0.039
min2.070-2.192=-0.122
max2.680-2.703=-0.022
iters=5
new-facts=6402
prior-facts=6402
mean1894.277-1891.974=2.303
σ0.073-0.082=-0.009
min1894.149-1891.835=2.314
max1894.331-1892.054=2.277
mean1741.200-1737.200=4.000
σ215.965-180.442=35.523
min1518.000-1507.000=11.000
max2046.000-1913.000=133.000
mean2.974-3.163=-0.188
σ0.113-0.401=-0.288
min2.902-2.877=0.024
max3.174-3.857=-0.682

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.591-1.734=-0.143
σ0.305-0.173=0.132
min1.243-1.429=-0.186
max1.850-1.858=-0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.232-443.995=4.237
σ581.601-575.268=6.333
min157.429-156.356=1.073
max1320.634-1306.897=13.737
mean96.250
σ8.500
min92.000
max109.000
mean1518.000-1454.000=64.000
σ0.000
min1518.000-1454.000=64.000
max1518.000-1454.000=64.000
mean0.531-0.534=-0.003
σ0.534-0.545=-0.011
min0.263-0.258=0.004
max1.332-1.351=-0.019
policies=20
mean1574.569-1563.899=10.670
σ0.341-0.338=0.003
min1574.356-1563.676=10.681
max1575.079-1564.403=10.676
mean920.000
σ0.000
min920.000
max920.000
mean1518.000-1454.000=64.000
σ0.000
min1518.000-1454.000=64.000
max1518.000-1454.000=64.000
mean2.625-2.610=0.014
σ0.015-0.006=0.009
min2.615-2.603=0.012
max2.647-2.618=0.029
policies=200
mean15754.082-15647.009=107.074
σ0.175-0.060=0.116
min15753.866-15646.931=106.935
max15754.232-15647.071=107.162
mean9200.000
σ0.000
min9200.000
max9200.000
mean1518.000-1454.000=64.000
σ0.000
min1518.000-1454.000=64.000
max1518.000-1454.000=64.000
mean26.511-26.356=0.156
σ0.143-0.148=-0.004
min26.361-26.233=0.127
max26.650-26.562=0.087