Compare commits

Home / Compare c0993f14 .. 088f9926

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.388=0.001
σ0.045-0.046=-0.000
min70.361-70.361=0.000
max70.516-70.515=0.000
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.158-0.153=0.004
σ0.003-0.006=-0.003
min0.155-0.148=0.007
max0.164-0.164=0.000
cache=y
dps=1
iters=10
policies=100
mean21.144-21.145=-0.001
σ0.002-0.003=-0.001
min21.141-21.141=0.000
max21.147-21.151=-0.004
mean414.000-412.800=1.200
σ0.000-0.422=-0.422
min414.000-412.000=2.000
max414.000-413.000=1.000
mean0.062-0.063=-0.001
σ0.004-0.003=0.001
min0.058-0.057=0.001
max0.068-0.066=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.001
σ0.361-0.362=-0.001
min1751.827-1751.831=-0.004
max1752.980-1752.982=-0.002
mean1659.550-1654.450=5.100
σ636.812-629.594=7.219
min621.000-617.000=4.000
max2790.000-2771.000=19.000
mean2.833-2.831=0.002
σ0.206-0.147=0.059
min2.192-2.352=-0.160
max3.087-3.058=0.030

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.144-270.140=0.004
σ0.008-0.007=0.001
min270.136-270.131=0.006
max270.152-270.148=0.004
mean2790.000-2771.000=19.000
σ0.000
min2790.000-2771.000=19.000
max2790.000-2771.000=19.000
mean0.382-0.378=0.004
σ0.013-0.005=0.008
min0.371-0.370=0.001
max0.404-0.383=0.021
iters=5
new-facts=1
prior-facts=6402
mean1930.597-1930.613=-0.016
σ0.026-0.007=0.019
min1930.555-1930.602=-0.046
max1930.620-1930.620=-0.000
mean2790.000-2771.000=19.000
σ0.000
min2790.000-2771.000=19.000
max2790.000-2771.000=19.000
mean2.523-2.481=0.042
σ0.129-0.038=0.091
min2.371-2.443=-0.072
max2.712-2.523=0.189
iters=5
new-facts=6402
prior-facts=1
mean4751.190-4751.364=-0.174
σ1.031-0.840=0.191
min4750.235-4750.891=-0.656
max4752.944-4752.858=0.086
mean2790.000-2771.000=19.000
σ0.000
min2790.000-2771.000=19.000
max2790.000-2771.000=19.000
mean8.935-8.256=0.680
σ0.404-0.415=-0.011
min8.400-7.653=0.747
max9.449-8.619=0.830
iters=5
new-facts=6402
prior-facts=6402
mean4941.772-4941.777=-0.005
σ0.012-0.023=-0.011
min4941.761-4941.756=0.006
max4941.791-4941.812=-0.021
mean3045.200-3031.400=13.800
σ205.020-209.027=-4.007
min2790.000-2771.000=19.000
max3324.000-3314.000=10.000
mean8.506-8.593=-0.087
σ0.136-0.328=-0.191
min8.367-8.322=0.045
max8.680-9.124=-0.444

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.998-1.040=-0.042
σ0.139-0.191=-0.052
min0.928-0.923=0.004
max1.247-1.367=-0.120

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.377-466.376=0.001
σ575.927-575.940=-0.013
min178.407-178.401=0.005
max1330.267-1330.285=-0.018
mean84.250
σ8.500
min80.000
max97.000
mean2790.000-2771.000=19.000
σ0.000
min2790.000-2771.000=19.000
max2790.000-2771.000=19.000
mean0.443-0.439=0.004
σ0.308-0.303=0.005
min0.288-0.286=0.002
max0.905-0.894=0.011
policies=20
mean1784.372-1784.337=0.035
σ0.369-0.339=0.030
min1784.119-1784.101=0.017
max1784.916-1784.831=0.085
mean800.000
σ0.000
min800.000
max800.000
mean2790.000-2771.000=19.000
σ0.000
min2790.000-2771.000=19.000
max2790.000-2771.000=19.000
mean2.838-2.828=0.010
σ0.094-0.121=-0.026
min2.760-2.763=-0.004
max2.963-3.009=-0.045
policies=200
mean17849.868-17849.769=0.099
σ0.455-0.431=0.024
min17849.573-17849.499=0.073
max17850.543-17850.409=0.133
mean8000.000
σ0.000
min8000.000
max8000.000
mean2790.000-2771.000=19.000
σ0.000
min2790.000-2771.000=19.000
max2790.000-2771.000=19.000
mean27.929-27.957=-0.029
σ0.173-0.121=0.052
min27.756-27.838=-0.082
max28.163-28.091=0.072