Compare commits

Home / Compare 0280ab5f .. 58a51193

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.967-35.967=0.001
σ0.103-0.104=-0.001
min35.922-35.920=0.002
max36.258-36.260=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.077-0.075=0.002
σ0.004-0.004=-0.001
min0.074-0.071=0.003
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.001
σ0.004-0.004=-0.001
min26.203-26.203=0.001
max26.215-26.218=-0.002
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.060-0.061=-0.001
σ0.003-0.002=0.001
min0.058-0.059=-0.002
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.314-1756.314=-0.000
σ0.369-0.367=0.002
min1755.739-1755.741=-0.002
max1756.908-1756.910=-0.002
mean1657.850-1655.400=2.450
σ628.019-626.808=1.211
min612.000-609.000=3.000
max2707.000-2643.000=64.000
mean2.382-2.372=0.010
σ0.128-0.160=-0.032
min2.262-2.242=0.020
max2.812-2.997=-0.184

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.842-278.844=-0.001
σ0.009-0.005=0.004
min278.826-278.837=-0.011
max278.849-278.849=-0.000
mean2707.000-2643.000=64.000
σ0.000
min2707.000-2643.000=64.000
max2707.000-2643.000=64.000
mean0.416-0.407=0.009
σ0.006-0.002=0.003
min0.408-0.404=0.004
max0.424-0.410=0.014
iters=5
new-facts=1
prior-facts=6402
mean2268.906-2268.904=0.002
σ0.007-0.011=-0.004
min2268.893-2268.885=0.008
max2268.910-2268.912=-0.003
mean2707.000-2643.000=64.000
σ0.000
min2707.000-2643.000=64.000
max2707.000-2643.000=64.000
mean2.963-2.965=-0.002
σ0.138-0.104=0.034
min2.874-2.888=-0.014
max3.207-3.145=0.062
iters=5
new-facts=6402
prior-facts=1
mean4954.151-4954.240=-0.090
σ0.941-0.806=0.135
min4953.433-4953.738=-0.305
max4955.802-4955.661=0.140
mean2707.000-2643.000=64.000
σ0.000
min2707.000-2643.000=64.000
max2707.000-2643.000=64.000
mean8.070-8.064=0.007
σ0.369-0.235=0.133
min7.700-7.821=-0.121
max8.604-8.407=0.197
iters=5
new-facts=6402
prior-facts=6402
mean5168.813-5168.675=0.138
σ0.083-0.201=-0.118
min5168.744-5168.392=0.353
max5168.905-5168.902=0.003
mean3421.000-3460.800=-39.800
σ459.802-475.553=-15.750
min2778.000-2796.000=-18.000
max3987.000-4019.000=-32.000
mean9.279-9.273=0.006
σ0.310-0.216=0.093
min8.917-8.963=-0.046
max9.770-9.564=0.206

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.207=-0.151
σ0.131-0.387=-0.256
min0.940-0.937=0.003
max1.263-1.871=-0.608

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.360-460.363=-0.003
σ572.653-572.652=0.001
min174.029-174.027=0.002
max1319.340-1319.341=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean2707.000-2643.000=64.000
σ0.000
min2707.000-2643.000=64.000
max2707.000-2643.000=64.000
mean0.541-0.538=0.003
σ0.534-0.532=0.002
min0.269-0.269=0.000
max1.343-1.336=0.006
policies=20
mean1740.499-1740.492=0.007
σ0.319-0.308=0.011
min1740.293-1740.300=-0.008
max1740.974-1740.952=0.023
mean760.000
σ0.000
min760.000
max760.000
mean2707.000-2643.000=64.000
σ0.000
min2707.000-2643.000=64.000
max2707.000-2643.000=64.000
mean2.678-2.679=-0.000
σ0.009-0.010=-0.001
min2.666-2.667=-0.001
max2.685-2.689=-0.004
policies=200
mean17411.944-17411.950=-0.006
σ0.450-0.404=0.046
min17411.705-17411.734=-0.029
max17412.618-17412.556=0.062
mean7600.000
σ0.000
min7600.000
max7600.000
mean2707.000-2643.000=64.000
σ0.000
min2707.000-2643.000=64.000
max2707.000-2643.000=64.000
mean26.979-26.983=-0.004
σ0.034-0.092=-0.058
min26.944-26.855=0.090
max27.026-27.074=-0.047