Compare commits

Home / Compare cc8223d4 .. bc3981bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.775-70.778=-0.003
σ0.051-0.048=0.003
min70.745-70.745=0.001
max70.915-70.910=0.005
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.162-0.160=0.001
σ0.003-0.004=-0.001
min0.156-0.153=0.003
max0.167-0.166=0.001
cache=y
dps=1
iters=10
policies=100
mean21.491-21.489=0.001
σ0.002-0.003=-0.000
min21.487-21.485=0.002
max21.493-21.492=0.001
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.066-0.063=0.004
σ0.002-0.003=-0.001
min0.064-0.059=0.006
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.287-1754.529=0.758
σ0.361-0.361=-0.000
min1754.718-1753.953=0.765
max1755.869-1755.130=0.738
mean1626.450-1667.400=-40.950
σ594.388-648.456=-54.068
min638.000-639.000=-1.000
max2420.000-2838.000=-418.000
mean2.810-2.803=0.007
σ0.229-0.148=0.081
min2.149-2.377=-0.229
max3.139-3.056=0.082

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.769-273.602=-0.833
σ0.004-0.010=-0.006
min272.764-273.589=-0.825
max272.773-273.612=-0.839
mean2420.000-2838.000=-418.000
σ0.000
min2420.000-2838.000=-418.000
max2420.000-2838.000=-418.000
mean0.384-0.384=-0.001
σ0.004-0.005=-0.000
min0.380-0.380=-0.000
max0.389-0.391=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1933.151-1933.998=-0.848
σ0.020-0.008=0.012
min1933.123-1933.988=-0.865
max1933.174-1934.009=-0.835
mean2420.000-2838.000=-418.000
σ0.000
min2420.000-2838.000=-418.000
max2420.000-2838.000=-418.000
mean3.080-3.003=0.077
σ0.174-0.062=0.112
min2.954-2.936=0.019
max3.388-3.090=0.298
iters=5
new-facts=6402
prior-facts=1
mean4753.824-4754.843=-1.020
σ0.929-0.784=0.145
min4752.889-4754.442=-1.553
max4755.385-4756.244=-0.859
mean2420.000-2838.000=-418.000
σ0.000
min2420.000-2838.000=-418.000
max2420.000-2838.000=-418.000
mean8.410-7.911=0.500
σ0.293-0.286=0.006
min8.105-7.697=0.408
max8.846-8.410=0.436
iters=5
new-facts=6402
prior-facts=6402
mean4944.381-4945.217=-0.836
σ0.023-0.015=0.008
min4944.354-4945.197=-0.842
max4944.406-4945.232=-0.826
mean2898.600-3038.200=-139.600
σ392.243-272.930=119.313
min2420.000-2838.000=-418.000
max3424.000-3469.000=-45.000
mean8.404-8.483=-0.079
σ0.046-0.116=-0.070
min8.355-8.369=-0.014
max8.461-8.664=-0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.764-1.041=0.723
σ0.127-0.121=0.007
min1.586-0.930=0.656
max1.873-1.224=0.649

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.834-472.846=-0.011
σ574.921-574.926=-0.005
min185.369-185.369=-0.000
max1335.216-1335.235=-0.019
mean88.250
σ8.500
min84.000
max101.000
mean2420.000-2838.000=-418.000
σ0.000
min2420.000-2838.000=-418.000
max2420.000-2838.000=-418.000
mean0.575-0.450=0.125
σ0.580-0.299=0.281
min0.275-0.299=-0.024
max1.444-0.899=0.546
policies=20
mean1853.942-1854.024=-0.082
σ0.376-0.366=0.010
min1853.689-1853.760=-0.071
max1854.499-1854.559=-0.060
mean840.000
σ0.000
min840.000
max840.000
mean2420.000-2838.000=-418.000
σ0.000
min2420.000-2838.000=-418.000
max2420.000-2838.000=-418.000
mean2.867-2.946=-0.079
σ0.012-0.004=0.008
min2.858-2.941=-0.083
max2.885-2.949=-0.064
policies=200
mean18546.621-18546.599=0.022
σ0.546-0.516=0.030
min18546.233-18546.201=0.032
max18547.410-18547.333=0.078
mean8400.000
σ0.000
min8400.000
max8400.000
mean2420.000-2838.000=-418.000
σ0.000
min2420.000-2838.000=-418.000
max2420.000-2838.000=-418.000
mean28.779-29.117=-0.338
σ0.093-0.561=-0.468
min28.655-28.784=-0.129
max28.864-29.957=-1.093