Compare commits

Home / Compare 39e35790 .. 34447a2b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.389-70.389=0.001
σ0.048-0.045=0.003
min70.361-70.356=0.005
max70.524-70.515=0.009
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.158-0.159=-0.001
σ0.005-0.005=-0.000
min0.151-0.151=-0.000
max0.164-0.166=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.145-21.144=0.001
σ0.002-0.002=-0.000
min21.141-21.141=0.000
max21.148-21.148=-0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.062-0.062=-0.000
σ0.003-0.004=-0.000
min0.058-0.059=-0.001
max0.068-0.071=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.394-1752.395=-0.001
σ0.361-0.359=0.002
min1751.831-1751.825=0.006
max1752.975-1752.972=0.003
mean1665.250-1641.450=23.800
σ624.766-618.166=6.600
min638.000-625.000=13.000
max2517.000-2479.000=38.000
mean2.822-2.838=-0.016
σ0.136-0.117=0.019
min2.500-2.493=0.007
max2.976-3.045=-0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.150-270.141=0.009
σ0.004-0.005=-0.001
min270.143-270.134=0.010
max270.154-270.147=0.008
mean2517.000-2479.000=38.000
σ0.000
min2517.000-2479.000=38.000
max2517.000-2479.000=38.000
mean0.386-0.383=0.003
σ0.009-0.011=-0.002
min0.378-0.376=0.002
max0.398-0.402=-0.003
iters=5
new-facts=1
prior-facts=6402
mean1930.575-1930.613=-0.039
σ0.040-0.009=0.031
min1930.505-1930.601=-0.096
max1930.607-1930.622=-0.015
mean2517.000-2479.000=38.000
σ0.000
min2517.000-2479.000=38.000
max2517.000-2479.000=38.000
mean2.487-2.502=-0.015
σ0.125-0.060=0.065
min2.298-2.454=-0.155
max2.621-2.592=0.029
iters=5
new-facts=6402
prior-facts=1
mean4751.211-4751.330=-0.119
σ1.111-0.890=0.220
min4750.214-4750.820=-0.607
max4753.122-4752.913=0.209
mean2517.000-2479.000=38.000
σ0.000
min2517.000-2479.000=38.000
max2517.000-2479.000=38.000
mean8.737-8.403=0.334
σ0.737-0.451=0.286
min7.800-7.685=0.115
max9.786-8.891=0.895
iters=5
new-facts=6402
prior-facts=6402
mean4941.773-4941.707=0.066
σ0.019-0.160=-0.140
min4941.750-4941.422=0.327
max4941.789-4941.797=-0.007
mean2892.200-3023.800=-131.600
σ334.422-262.406=72.017
min2517.000-2631.000=-114.000
max3350.000-3331.000=19.000
mean8.351-8.673=-0.322
σ0.085-0.470=-0.384
min8.210-8.379=-0.169
max8.412-9.494=-1.082

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.637-1.742=-0.105
σ0.192-0.152=0.040
min1.402-1.548=-0.146
max1.895-1.909=-0.013

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.364-466.364=-0.000
σ575.920-575.918=0.002
min178.399-178.400=-0.001
max1330.244-1330.241=0.003
mean84.000
σ8.000
min80.000
max96.000
mean2517.000-2479.000=38.000
σ0.000
min2517.000-2479.000=38.000
max2517.000-2479.000=38.000
mean0.557-0.561=-0.004
σ0.550-0.560=-0.010
min0.280-0.280=0.000
max1.381-1.401=-0.020
policies=20
mean1784.295-1784.296=-0.001
σ0.354-0.355=-0.001
min1784.059-1784.067=-0.008
max1784.821-1784.825=-0.004
mean800.000
σ0.000
min800.000
max800.000
mean2517.000-2479.000=38.000
σ0.000
min2517.000-2479.000=38.000
max2517.000-2479.000=38.000
mean2.782-2.773=0.009
σ0.026-0.017=0.009
min2.757-2.758=-0.001
max2.819-2.797=0.022
policies=200
mean17849.839-17849.760=0.079
σ0.480-0.404=0.076
min17849.466-17849.433=0.033
max17850.544-17850.335=0.210
mean8000.000
σ0.000
min8000.000
max8000.000
mean2517.000-2479.000=38.000
σ0.000
min2517.000-2479.000=38.000
max2517.000-2479.000=38.000
mean27.933-27.866=0.068
σ0.051-0.080=-0.029
min27.859-27.798=0.062
max27.972-27.976=-0.004