Compare commits

Home / Compare e9bc3b11 .. dbca404e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.837-53.839=-0.002
σ0.367-0.366=0.001
min53.688-53.692=-0.003
max54.881-54.881=-0.000
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.140-0.150=-0.010
σ0.008-0.011=-0.003
min0.130-0.135=-0.005
max0.159-0.165=-0.006
cache=y
dps=1
iters=10
policies=100
mean43.211-43.209=0.002
σ0.008-0.008=0.000
min43.200-43.198=0.002
max43.229-43.223=0.006
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.129-0.124=0.005
σ0.008-0.008=0.000
min0.118-0.119=-0.002
max0.138-0.143=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.209=-0.003
σ1.186-1.149=0.037
min1015.630-1015.631=-0.001
max1021.173-1021.011=0.162
mean1046.250-1043.150=3.100
σ311.460-310.567=0.894
min554.000-578.000=-24.000
max1511.000-1630.000=-119.000
mean1.525-1.537=-0.011
σ0.060-0.102=-0.042
min1.445-1.377=0.068
max1.652-1.820=-0.168

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.363-301.305=0.059
σ0.218-0.213=0.005
min301.231-301.101=0.130
max301.958-301.877=0.081
mean2013.000-1946.000=67.000
σ0.000
min2013.000-1946.000=67.000
max2013.000-1946.000=67.000
mean0.537-0.584=-0.047
σ0.031-0.025=0.006
min0.506-0.519=-0.012
max0.581-0.606=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.475-301.486=-0.012
σ0.063-0.045=0.018
min301.374-301.425=-0.051
max301.534-301.538=-0.005
mean1511.000-1630.000=-119.000
σ0.000
min1511.000-1630.000=-119.000
max1511.000-1630.000=-119.000
mean0.395-0.396=-0.001
σ0.006-0.006=-0.000
min0.391-0.389=0.002
max0.406-0.404=0.002
iters=5
new-facts=1
prior-facts=6402
mean1324.060-1324.059=0.001
σ0.110-0.105=0.006
min1323.924-1323.932=-0.008
max1324.198-1324.202=-0.004
mean1511.000-1630.000=-119.000
σ0.000
min1511.000-1630.000=-119.000
max1511.000-1630.000=-119.000
mean1.881-1.967=-0.086
σ0.058-0.130=-0.073
min1.820-1.820=-0.000
max1.965-2.178=-0.213
iters=5
new-facts=6402
prior-facts=1
mean1562.077-1562.086=-0.009
σ6.911-6.909=0.003
min1558.798-1558.761=0.037
max1574.436-1574.438=-0.002
mean1511.000-1630.000=-119.000
σ0.000
min1511.000-1630.000=-119.000
max1511.000-1630.000=-119.000
mean2.300-2.354=-0.053
σ0.290-0.279=0.011
min2.027-2.035=-0.008
max2.639-2.673=-0.034
iters=5
new-facts=6402
prior-facts=6402
mean1891.978-1891.982=-0.004
σ0.067-0.076=-0.009
min1891.859-1891.847=0.011
max1892.016-1892.028=-0.012
mean1731.200-1799.400=-68.200
σ209.771-120.558=89.212
min1511.000-1630.000=-119.000
max2013.000-1946.000=67.000
mean2.903-2.974=-0.071
σ0.033-0.151=-0.118
min2.876-2.837=0.040
max2.957-3.200=-0.243

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.561-1.199=0.362
σ0.254-0.261=-0.007
min1.234-1.031=0.203
max1.748-1.645=0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.480-443.493=-0.013
σ574.238-574.239=-0.001
min156.360-156.370=-0.010
max1304.837-1304.851=-0.014
mean96.250
σ8.500
min92.000
max109.000
mean1511.000-1630.000=-119.000
σ0.000
min1511.000-1630.000=-119.000
max1511.000-1630.000=-119.000
mean0.545-0.532=0.014
σ0.569-0.527=0.041
min0.252-0.264=-0.012
max1.398-1.323=0.076
policies=20
mean1563.887-1563.914=-0.026
σ0.344-0.328=0.016
min1563.664-1563.717=-0.053
max1564.400-1564.404=-0.004
mean920.000
σ0.000
min920.000
max920.000
mean1511.000-1630.000=-119.000
σ0.000
min1511.000-1630.000=-119.000
max1511.000-1630.000=-119.000
mean2.620-2.610=0.009
σ0.009-0.016=-0.007
min2.608-2.592=0.016
max2.629-2.628=0.001
policies=200
mean15647.016-15646.937=0.080
σ0.097-0.021=0.077
min15646.889-15646.907=-0.018
max15647.125-15646.955=0.170
mean9200.000
σ0.000
min9200.000
max9200.000
mean1511.000-1630.000=-119.000
σ0.000
min1511.000-1630.000=-119.000
max1511.000-1630.000=-119.000
mean26.562-26.393=0.169
σ0.122-0.109=0.012
min26.423-26.268=0.155
max26.692-26.522=0.170