Compare commits

Home / Compare 6c4de53b .. ca2b612d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.568-70.562=0.005
σ0.045-0.044=0.000
min70.543-70.538=0.004
max70.690-70.687=0.003
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.161-0.157=0.003
σ0.003-0.005=-0.002
min0.158-0.151=0.007
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.288-21.292=-0.003
σ0.003-0.012=-0.008
min21.282-21.284=-0.002
max21.293-21.324=-0.031
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.064-0.064=0.001
σ0.002-0.003=-0.001
min0.063-0.058=0.005
max0.070-0.070=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.376-1753.373=0.002
σ0.360-0.359=0.001
min1752.803-1752.806=-0.003
max1753.969-1753.950=0.019
mean1648.250-1658.900=-10.650
σ643.449-635.913=7.536
min619.000-616.000=3.000
max2718.000-2805.000=-87.000
mean2.861-2.738=0.123
σ0.117-0.189=-0.072
min2.630-2.303=0.327
max3.087-3.092=-0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.756-271.758=-0.003
σ0.005-0.007=-0.002
min271.749-271.750=-0.001
max271.762-271.766=-0.004
mean2718.000-2805.000=-87.000
σ0.000
min2718.000-2805.000=-87.000
max2718.000-2805.000=-87.000
mean0.381-0.381=-0.001
σ0.005-0.007=-0.002
min0.377-0.371=0.006
max0.389-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1932.179-1932.177=0.002
σ0.006-0.006=0.000
min1932.171-1932.169=0.002
max1932.186-1932.185=0.001
mean2718.000-2805.000=-87.000
σ0.000
min2718.000-2805.000=-87.000
max2718.000-2805.000=-87.000
mean3.059-3.050=0.010
σ0.046-0.064=-0.018
min2.997-2.991=0.006
max3.100-3.123=-0.023
iters=5
new-facts=6402
prior-facts=1
mean4752.950-4752.947=0.003
σ0.888-0.836=0.051
min4752.407-4752.349=0.058
max4754.529-4754.419=0.110
mean2718.000-2805.000=-87.000
σ0.000
min2718.000-2805.000=-87.000
max2718.000-2805.000=-87.000
mean8.288-8.160=0.128
σ0.492-0.668=-0.176
min7.685-7.663=0.022
max8.975-9.226=-0.251
iters=5
new-facts=6402
prior-facts=6402
mean4943.379-4943.368=0.011
σ0.017-0.025=-0.008
min4943.358-4943.344=0.014
max4943.400-4943.398=0.001
mean2998.600-3057.400=-58.800
σ327.901-317.311=10.590
min2718.000-2805.000=-87.000
max3475.000-3537.000=-62.000
mean8.576-8.396=0.180
σ0.188-0.102=0.085
min8.340-8.305=0.034
max8.746-8.556=0.190

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.060-1.087=-0.026
σ0.209-0.111=0.098
min0.933-0.938=-0.005
max1.422-1.243=0.179

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.863-467.859=0.004
σ575.935-575.931=0.003
min179.885-179.889=-0.003
max1331.766-1331.756=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2718.000-2805.000=-87.000
σ0.000
min2718.000-2805.000=-87.000
max2718.000-2805.000=-87.000
mean0.571-0.474=0.097
σ0.559-0.393=0.166
min0.284-0.273=0.011
max1.409-1.064=0.345
policies=20
mean1799.158-1799.168=-0.010
σ0.371-0.369=0.002
min1798.917-1798.921=-0.005
max1799.711-1799.717=-0.006
mean820.000
σ0.000
min820.000
max820.000
mean2718.000-2805.000=-87.000
σ0.000
min2718.000-2805.000=-87.000
max2718.000-2805.000=-87.000
mean2.782-2.783=-0.001
σ0.014-0.017=-0.002
min2.765-2.762=0.004
max2.801-2.803=-0.002
policies=200
mean17998.380-17998.409=-0.029
σ0.591-0.585=0.006
min17998.007-17998.087=-0.080
max17999.259-17999.285=-0.026
mean8200.000
σ0.000
min8200.000
max8200.000
mean2718.000-2805.000=-87.000
σ0.000
min2718.000-2805.000=-87.000
max2718.000-2805.000=-87.000
mean28.100-28.095=0.005
σ0.086-0.173=-0.086
min28.019-27.930=0.090
max28.211-28.334=-0.124