Compare commits

Home / Compare 1c683d8e .. 2a399bf7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.837=-0.001
σ0.369-0.367=0.001
min53.690-53.695=-0.004
max54.885-54.882=0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.140-0.139=0.001
σ0.003-0.004=-0.001
min0.137-0.136=0.001
max0.146-0.147=-0.000
cache=y
dps=1
iters=10
policies=100
mean43.208-43.209=-0.001
σ0.006-0.007=-0.001
min43.199-43.199=-0.000
max43.218-43.221=-0.003
mean416.000-417.000=-1.000
σ0.000
min416.000-417.000=-1.000
max416.000-417.000=-1.000
mean0.121-0.122=-0.001
σ0.004-0.005=-0.000
min0.114-0.114=-0.000
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.206-1016.201=0.005
σ1.164-1.199=-0.035
min1015.630-1015.666=-0.037
max1021.079-1021.232=-0.153
mean1047.400-1054.700=-7.300
σ311.687-301.419=10.268
min555.000-604.000=-49.000
max1512.000-1454.000=58.000
mean1.525-1.550=-0.025
σ0.056-0.097=-0.041
min1.463-1.458=0.004
max1.627-1.764=-0.137

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.340-301.333=0.007
σ0.262-0.182=0.080
min301.176-301.204=-0.028
max302.056-301.836=0.220
mean1951.000-1949.000=2.000
σ0.000
min1951.000-1949.000=2.000
max1951.000-1949.000=2.000
mean0.567-0.542=0.025
σ0.033-0.033=-0.001
min0.508-0.505=0.002
max0.602-0.578=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.479-301.488=-0.008
σ0.048-0.039=0.009
min301.407-301.433=-0.027
max301.527-301.533=-0.006
mean1512.000-1454.000=58.000
σ0.000
min1512.000-1454.000=58.000
max1512.000-1454.000=58.000
mean0.393-0.393=0.000
σ0.005-0.005=-0.000
min0.389-0.388=0.001
max0.400-0.399=0.000
iters=5
new-facts=1
prior-facts=6402
mean1324.062-1324.047=0.016
σ0.117-0.102=0.014
min1323.923-1323.919=0.004
max1324.182-1324.192=-0.011
mean1512.000-1454.000=58.000
σ0.000
min1512.000-1454.000=58.000
max1512.000-1454.000=58.000
mean1.918-1.915=0.003
σ0.091-0.066=0.025
min1.819-1.842=-0.023
max2.032-1.982=0.050
iters=5
new-facts=6402
prior-facts=1
mean1562.092-1562.077=0.016
σ6.934-6.917=0.017
min1558.754-1558.771=-0.016
max1574.490-1574.444=0.046
mean1512.000-1454.000=58.000
σ0.000
min1512.000-1454.000=58.000
max1512.000-1454.000=58.000
mean2.403-2.336=0.067
σ0.313-0.335=-0.023
min2.140-2.113=0.027
max2.905-2.923=-0.018
iters=5
new-facts=6402
prior-facts=6402
mean1891.972-1891.980=-0.008
σ0.067-0.070=-0.003
min1891.852-1891.858=-0.006
max1892.014-1892.030=-0.016
mean1758.400-1759.200=-0.800
σ151.125-149.759=1.366
min1530.000-1532.000=-2.000
max1951.000-1949.000=2.000
mean2.959-2.983=-0.025
σ0.107-0.121=-0.014
min2.885-2.879=0.006
max3.143-3.177=-0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.531-1.681=-0.149
σ0.284-0.124=0.161
min1.178-1.499=-0.321
max1.823-1.824=-0.001

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.483-443.481=0.001
σ574.236-574.232=0.004
min156.361-156.362=-0.001
max1304.837-1304.830=0.007
mean96.250
σ8.500
min92.000
max109.000
mean1512.000-1454.000=58.000
σ0.000
min1512.000-1454.000=58.000
max1512.000-1454.000=58.000
mean0.543-0.547=-0.004
σ0.562-0.573=-0.011
min0.260-0.256=0.004
max1.386-1.406=-0.021
policies=20
mean1563.892-1563.900=-0.008
σ0.333-0.332=0.001
min1563.668-1563.684=-0.016
max1564.388-1564.395=-0.007
mean920.000
σ0.000
min920.000
max920.000
mean1512.000-1454.000=58.000
σ0.000
min1512.000-1454.000=58.000
max1512.000-1454.000=58.000
mean2.603-2.609=-0.006
σ0.010-0.006=0.004
min2.593-2.601=-0.008
max2.616-2.616=0.000
policies=200
mean15647.017-15646.973=0.045
σ0.100-0.048=0.052
min15646.869-15646.937=-0.068
max15647.086-15647.043=0.042
mean9200.000
σ0.000
min9200.000
max9200.000
mean1512.000-1454.000=58.000
σ0.000
min1512.000-1454.000=58.000
max1512.000-1454.000=58.000
mean26.496-26.383=0.113
σ0.286-0.165=0.122
min26.237-26.236=0.001
max26.861-26.605=0.256