Compare commits

Home / Compare 043a523b .. 88e121a1

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.781-70.783=-0.002
σ0.047-0.045=0.002
min70.751-70.752=-0.001
max70.911-70.907=0.004
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.158-0.160=-0.002
σ0.005-0.004=0.001
min0.150-0.157=-0.007
max0.165-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=-0.000
σ0.002-0.003=-0.001
min21.489-21.487=0.002
max21.496-21.495=0.001
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.063=-0.000
max0.074-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.897-1754.093=0.803
σ0.362-0.361=0.002
min1754.333-1753.534=0.799
max1755.490-1754.674=0.816
mean1638.750-1638.150=0.600
σ629.784-617.949=11.835
min625.000-644.000=-19.000
max2786.000-2478.000=308.000
mean2.831-2.861=-0.030
σ0.180-0.104=0.076
min2.318-2.562=-0.244
max3.131-3.002=0.129

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.759-271.955=0.804
σ0.004-0.004=0.000
min272.751-271.950=0.801
max272.763-271.958=0.805
mean2786.000-2478.000=308.000
σ0.000
min2786.000-2478.000=308.000
max2786.000-2478.000=308.000
mean0.387-0.386=0.001
σ0.005-0.009=-0.004
min0.381-0.379=0.002
max0.394-0.399=-0.005
iters=5
new-facts=1
prior-facts=6402
mean1933.132-1932.321=0.811
σ0.012-0.010=0.001
min1933.115-1932.305=0.810
max1933.145-1932.329=0.816
mean2786.000-2478.000=308.000
σ0.000
min2786.000-2478.000=308.000
max2786.000-2478.000=308.000
mean3.085-2.965=0.120
σ0.285-0.054=0.231
min2.661-2.894=-0.233
max3.439-3.032=0.407
iters=5
new-facts=6402
prior-facts=1
mean4753.801-4753.070=0.730
σ1.024-0.896=0.128
min4752.814-4752.602=0.212
max4755.535-4754.669=0.867
mean2786.000-2478.000=308.000
σ0.000
min2786.000-2478.000=308.000
max2786.000-2478.000=308.000
mean8.326-8.591=-0.265
σ0.645-0.228=0.417
min7.666-8.245=-0.579
max9.033-8.848=0.185
iters=5
new-facts=6402
prior-facts=6402
mean4944.367-4943.488=0.878
σ0.019-0.150=-0.131
min4944.343-4943.221=1.123
max4944.385-4943.571=0.814
mean3024.400-2940.400=84.000
σ300.725-319.868=-19.144
min2786.000-2478.000=308.000
max3478.000-3333.000=145.000
mean8.510-8.424=0.086
σ0.197-0.105=0.091
min8.345-8.312=0.032
max8.737-8.537=0.200

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.012-1.750=-0.738
σ0.146-0.145=0.000
min0.945-1.496=-0.551
max1.272-1.860=-0.587

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.649-468.655=-0.006
σ574.912-574.928=-0.016
min181.191-181.190=0.001
max1331.017-1331.047=-0.031
mean88.250
σ8.500
min84.000
max101.000
mean2786.000-2478.000=308.000
σ0.000
min2786.000-2478.000=308.000
max2786.000-2478.000=308.000
mean0.487-0.565=-0.078
σ0.401-0.539=-0.138
min0.286-0.288=-0.001
max1.088-1.374=-0.285
policies=20
mean1812.218-1812.211=0.007
σ0.387-0.395=-0.008
min1811.951-1811.943=0.009
max1812.789-1812.792=-0.003
mean840.000
σ0.000
min840.000
max840.000
mean2786.000-2478.000=308.000
σ0.000
min2786.000-2478.000=308.000
max2786.000-2478.000=308.000
mean2.848-2.850=-0.002
σ0.027-0.013=0.014
min2.814-2.831=-0.017
max2.878-2.861=0.017
policies=200
mean18129.228-18129.228=-0.000
σ0.513-0.488=0.024
min18128.936-18128.954=-0.018
max18129.996-18129.960=0.036
mean8400.000
σ0.000
min8400.000
max8400.000
mean2786.000-2478.000=308.000
σ0.000
min2786.000-2478.000=308.000
max2786.000-2478.000=308.000
mean28.550-28.623=-0.073
σ0.020-0.061=-0.041
min28.522-28.580=-0.057
max28.565-28.714=-0.149