Compare commits

Home / Compare 7f254d85 .. ed233f7f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.784=-0.001
σ0.046-0.047=-0.002
min70.748-70.749=-0.001
max70.908-70.914=-0.006
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.156-0.161=-0.005
σ0.005-0.003=0.002
min0.147-0.158=-0.011
max0.162-0.166=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.492-21.492=0.000
σ0.002-0.002=0.000
min21.489-21.489=-0.000
max21.496-21.495=0.000
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.061-0.065=-0.004
σ0.004-0.002=0.002
min0.058-0.064=-0.005
max0.069-0.071=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1754.094=0.001
σ0.362-0.361=0.001
min1753.530-1753.537=-0.007
max1754.675-1754.676=-0.001
mean1649.000-1661.600=-12.600
σ637.943-634.679=3.264
min644.000-629.000=15.000
max2849.000-2777.000=72.000
mean2.824-2.813=0.011
σ0.185-0.172=0.014
min2.267-2.378=-0.111
max3.148-3.100=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.954-271.952=0.001
σ0.003-0.006=-0.003
min271.950-271.944=0.006
max271.957-271.959=-0.001
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean0.379-0.383=-0.004
σ0.001-0.008=-0.006
min0.377-0.378=-0.001
max0.381-0.397=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1932.328-1932.327=0.001
σ0.008-0.016=-0.008
min1932.319-1932.305=0.014
max1932.337-1932.346=-0.009
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean3.106-3.071=0.035
σ0.134-0.158=-0.024
min2.986-2.862=0.124
max3.270-3.236=0.034
iters=5
new-facts=6402
prior-facts=1
mean4753.005-4753.020=-0.015
σ1.007-0.542=0.465
min4752.021-4752.708=-0.687
max4754.695-4753.985=0.710
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean8.229-8.251=-0.022
σ0.724-0.303=0.422
min7.510-7.774=-0.264
max9.082-8.548=0.534
iters=5
new-facts=6402
prior-facts=6402
mean4943.492-4943.555=-0.063
σ0.153-0.023=0.131
min4943.219-4943.522=-0.303
max4943.576-4943.580=-0.005
mean3048.400-3052.200=-3.800
σ264.140-336.117=-71.977
min2849.000-2777.000=72.000
max3446.000-3559.000=-113.000
mean8.516-8.434=0.082
σ0.209-0.120=0.090
min8.284-8.332=-0.048
max8.751-8.642=0.109

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.064-1.039=0.026
σ0.177-0.109=0.067
min0.927-0.934=-0.007
max1.360-1.196=0.164

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.655-468.658=-0.003
σ574.880-574.881=-0.001
min181.204-181.212=-0.009
max1330.975-1330.980=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean0.449-0.480=-0.031
σ0.303-0.375=-0.072
min0.295-0.289=0.007
max0.904-1.042=-0.138
policies=20
mean1812.391-1812.394=-0.003
σ0.382-0.381=0.001
min1812.125-1812.124=0.001
max1812.950-1812.950=-0.000
mean840.000
σ0.000
min840.000
max840.000
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean2.928-2.960=-0.033
σ0.004-0.071=-0.067
min2.922-2.897=0.025
max2.931-3.047=-0.116
policies=200
mean18129.872-18129.183=0.689
σ0.865-0.539=0.327
min18128.731-18128.833=-0.103
max18130.727-18129.985=0.742
mean8400.000
σ0.000
min8400.000
max8400.000
mean2849.000-2777.000=72.000
σ0.000
min2849.000-2777.000=72.000
max2849.000-2777.000=72.000
mean29.100-28.681=0.419
σ0.586-0.021=0.565
min28.560-28.663=-0.102
max29.685-28.711=0.974