Compare commits

Home / Compare 5cedd6e9 .. 8460ff67

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.821-53.823=-0.001
σ0.366-0.369=-0.003
min53.678-53.684=-0.006
max54.861-54.872=-0.011
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.137-0.138=-0.002
σ0.005-0.003=0.002
min0.130-0.135=-0.005
max0.144-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.207-43.207=0.000
σ0.006-0.007=-0.001
min43.199-43.198=0.001
max43.217-43.221=-0.003
mean418.000-415.700=2.300
σ0.000-0.483=-0.483
min418.000-415.000=3.000
max418.000-416.000=2.000
mean0.122-0.121=0.001
σ0.004-0.002=0.001
min0.118-0.119=-0.001
max0.127-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.176-1016.180=-0.004
σ1.178-1.142=0.036
min1015.628-1015.603=0.025
max1021.109-1020.946=0.163
mean1050.200-1046.750=3.450
σ299.453-296.924=2.529
min581.000-587.000=-6.000
max1462.000-1464.000=-2.000
mean1.559-1.548=0.012
σ0.082-0.071=0.012
min1.483-1.427=0.056
max1.809-1.763=0.046

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.412-301.425=-0.013
σ0.203-0.214=-0.010
min301.272-301.234=0.038
max301.977-301.966=0.011
mean2037.000-2035.000=2.000
σ0.000
min2037.000-2035.000=2.000
max2037.000-2035.000=2.000
mean0.567-0.552=0.015
σ0.030-0.035=-0.005
min0.509-0.503=0.006
max0.595-0.590=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.702-300.694=0.008
σ0.028-0.026=0.002
min300.672-300.657=0.015
max300.739-300.724=0.015
mean1462.000-1464.000=-2.000
σ0.000
min1462.000-1464.000=-2.000
max1462.000-1464.000=-2.000
mean0.394-0.394=0.000
σ0.008-0.007=0.001
min0.388-0.388=-0.000
max0.406-0.402=0.005
iters=5
new-facts=1
prior-facts=6402
mean1322.860-1322.876=-0.016
σ0.092-0.095=-0.003
min1322.815-1322.818=-0.003
max1323.025-1323.039=-0.014
mean1462.000-1464.000=-2.000
σ0.000
min1462.000-1464.000=-2.000
max1462.000-1464.000=-2.000
mean1.921-1.925=-0.004
σ0.122-0.126=-0.004
min1.817-1.820=-0.003
max2.116-2.066=0.050
iters=5
new-facts=6402
prior-facts=1
mean1561.343-1561.324=0.019
σ6.870-6.839=0.031
min1558.014-1558.022=-0.008
max1573.627-1573.552=0.075
mean1462.000-1464.000=-2.000
σ0.000
min1462.000-1464.000=-2.000
max1462.000-1464.000=-2.000
mean2.413-2.360=0.053
σ0.343-0.225=0.118
min2.039-1.992=0.047
max2.752-2.573=0.180
iters=5
new-facts=6402
prior-facts=6402
mean1890.791-1890.792=-0.001
σ0.018-0.015=0.003
min1890.772-1890.781=-0.009
max1890.815-1890.817=-0.002
mean1724.000-1726.000=-2.000
σ228.324-233.458=-5.133
min1462.000-1464.000=-2.000
max2037.000-2035.000=2.000
mean2.906-2.926=-0.021
σ0.101-0.113=-0.012
min2.838-2.851=-0.013
max3.084-3.125=-0.042

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.667-1.697=-0.030
σ0.195-0.106=0.089
min1.391-1.522=-0.132
max1.879-1.782=0.097

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.324-443.046=0.278
σ573.978-573.420=0.558
min156.329-156.333=-0.005
max1304.291-1303.176=1.115
mean96.250
σ8.500
min92.000
max109.000
mean1462.000-1464.000=-2.000
σ0.000
min1462.000-1464.000=-2.000
max1462.000-1464.000=-2.000
mean0.559-0.544=0.015
σ0.603-0.560=0.043
min0.247-0.261=-0.014
max1.464-1.385=0.079
policies=20
mean1563.619-1563.620=-0.001
σ0.337-0.343=-0.006
min1563.408-1563.388=0.020
max1564.123-1564.131=-0.008
mean920.000
σ0.000
min920.000
max920.000
mean1462.000-1464.000=-2.000
σ0.000
min1462.000-1464.000=-2.000
max1462.000-1464.000=-2.000
mean2.611-2.624=-0.013
σ0.023-0.016=0.006
min2.577-2.604=-0.026
max2.629-2.642=-0.013
policies=200
mean15644.149-15644.072=0.077
σ0.093-0.060=0.034
min15644.019-15644.032=-0.013
max15644.225-15644.160=0.064
mean9200.000
σ0.000
min9200.000
max9200.000
mean1462.000-1464.000=-2.000
σ0.000
min1462.000-1464.000=-2.000
max1462.000-1464.000=-2.000
mean26.445-26.567=-0.122
σ0.182-0.222=-0.040
min26.202-26.407=-0.205
max26.637-26.881=-0.244