Compare commits

Home / Compare d64765d9 .. 1f3a0e37

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.827-53.822=0.006
σ0.367-0.367=-0.001
min53.690-53.677=0.013
max54.870-54.867=0.004
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.156-0.139=0.017
σ0.008-0.003=0.005
min0.137-0.135=0.002
max0.167-0.145=0.022
cache=y
dps=1
iters=10
policies=100
mean43.208-43.211=-0.003
σ0.006-0.007=-0.001
min43.200-43.201=-0.002
max43.215-43.226=-0.010
mean418.000-417.000=1.000
σ0.000
min418.000-417.000=1.000
max418.000-417.000=1.000
mean0.123-0.132=-0.010
σ0.003-0.013=-0.010
min0.119-0.113=0.006
max0.128-0.148=-0.020

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.179-1016.186=-0.008
σ1.178-1.157=0.021
min1015.630-1015.600=0.030
max1021.117-1021.013=0.103
mean1044.150-1050.000=-5.850
σ310.050-312.244=-2.194
min599.000-557.000=42.000
max1634.000-1516.000=118.000
mean1.550-1.539=0.011
σ0.070-0.066=0.004
min1.482-1.431=0.051
max1.795-1.682=0.113

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.220-301.497=-0.277
σ0.215-0.193=0.022
min301.054-301.325=-0.271
max301.802-301.988=-0.186
mean2014.000-1958.000=56.000
σ0.000
min2014.000-1958.000=56.000
max2014.000-1958.000=56.000
mean0.539-0.560=-0.021
σ0.029-0.032=-0.003
min0.508-0.506=0.002
max0.579-0.602=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.702-300.685=0.017
σ0.016-0.047=-0.031
min300.684-300.608=0.076
max300.724-300.726=-0.002
mean1634.000-1516.000=118.000
σ0.000
min1634.000-1516.000=118.000
max1634.000-1516.000=118.000
mean0.398-0.399=-0.001
σ0.007-0.010=-0.002
min0.390-0.389=0.001
max0.407-0.413=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1322.871-1322.865=0.006
σ0.089-0.098=-0.010
min1322.811-1322.804=0.008
max1323.018-1323.037=-0.019
mean1634.000-1516.000=118.000
σ0.000
min1634.000-1516.000=118.000
max1634.000-1516.000=118.000
mean1.898-1.944=-0.046
σ0.082-0.086=-0.004
min1.831-1.822=0.008
max2.010-2.037=-0.027
iters=5
new-facts=6402
prior-facts=1
mean1561.306-1561.305=0.001
σ6.892-6.884=0.007
min1557.972-1557.981=-0.009
max1573.627-1573.613=0.015
mean1634.000-1516.000=118.000
σ0.000
min1634.000-1516.000=118.000
max1634.000-1516.000=118.000
mean2.237-2.315=-0.078
σ0.286-0.226=0.060
min2.040-2.079=-0.039
max2.740-2.596=0.144
iters=5
new-facts=6402
prior-facts=6402
mean1890.792-1890.801=-0.009
σ0.021-0.023=-0.002
min1890.768-1890.780=-0.012
max1890.819-1890.841=-0.022
mean1771.000-1767.800=3.200
σ164.219-155.284=8.935
min1634.000-1533.000=101.000
max2014.000-1958.000=56.000
mean2.894-3.008=-0.114
σ0.138-0.134=0.004
min2.724-2.885=-0.161
max3.107-3.213=-0.105

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.215-1.548=-0.333
σ0.388-0.310=0.078
min0.912-1.206=-0.294
max1.876-1.837=0.039

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.048-443.038=0.011
σ573.415-573.402=0.013
min156.332-156.334=-0.002
max1303.171-1303.141=0.029
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1516.000=118.000
σ0.000
min1634.000-1516.000=118.000
max1634.000-1516.000=118.000
mean0.557-0.560=-0.003
σ0.586-0.584=0.002
min0.260-0.263=-0.003
max1.437-1.436=0.001
policies=20
mean1563.618-1563.580=0.038
σ0.336-0.335=0.001
min1563.429-1563.388=0.041
max1564.121-1564.082=0.039
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1516.000=118.000
σ0.000
min1634.000-1516.000=118.000
max1634.000-1516.000=118.000
mean2.626-2.625=0.000
σ0.011-0.005=0.007
min2.617-2.621=-0.004
max2.642-2.631=0.011
policies=200
mean15643.932-15643.889=0.043
σ0.057-0.147=-0.090
min15643.859-15643.755=0.104
max15643.989-15644.064=-0.074
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1516.000=118.000
σ0.000
min1634.000-1516.000=118.000
max1634.000-1516.000=118.000
mean26.534-26.551=-0.017
σ0.268-0.202=0.066
min26.304-26.389=-0.085
max26.838-26.816=0.022