Compare commits

Home / Compare df846969 .. 8b9615d0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.799=-5.025
σ0.046-0.106=-0.060
min30.752-35.753=-5.001
max30.904-36.100=-5.195
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.079-0.076=0.003
σ0.004-0.003=0.000
min0.076-0.073=0.002
max0.086-0.082=0.004
cache=y
dps=1
iters=10
policies=100
mean21.059-26.064=-5.005
σ0.002-0.002=-0.000
min21.056-26.060=-5.005
max21.062-26.068=-5.006
mean410.000-412.000=-2.000
σ0.000
min410.000-412.000=-2.000
max410.000-412.000=-2.000
mean0.062-0.061=0.001
σ0.004-0.002=0.001
min0.057-0.060=-0.003
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1755.924=-4.687
σ0.363-0.368=-0.005
min1750.669-1755.354=-4.685
max1751.822-1756.512=-4.691
mean1644.200-1644.550=-0.350
σ619.928-625.568=-5.640
min677.000-607.000=70.000
max2641.000-2656.000=-15.000
mean2.822-2.882=-0.060
σ0.192-0.144=0.048
min2.299-2.658=-0.359
max3.269-3.343=-0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.569-277.164=-1.595
σ0.008-0.008=-0.001
min275.563-277.154=-1.592
max275.582-277.173=-1.590
mean2641.000-2656.000=-15.000
σ0.000
min2641.000-2656.000=-15.000
max2641.000-2656.000=-15.000
mean0.391-0.394=-0.003
σ0.005-0.004=0.001
min0.387-0.391=-0.004
max0.397-0.400=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2168.096-2174.424=-6.327
σ0.013-0.005=0.007
min2168.083-2174.417=-6.334
max2168.116-2174.429=-6.313
mean2641.000-2656.000=-15.000
σ0.000
min2641.000-2656.000=-15.000
max2641.000-2656.000=-15.000
mean2.926-2.868=0.059
σ0.119-0.137=-0.018
min2.784-2.761=0.023
max3.107-3.101=0.006
iters=5
new-facts=6402
prior-facts=1
mean5047.721-5052.539=-4.817
σ0.763-1.063=-0.300
min5047.072-5051.681=-4.609
max5049.036-5054.381=-5.345
mean2641.000-2656.000=-15.000
σ0.000
min2641.000-2656.000=-15.000
max2641.000-2656.000=-15.000
mean8.861-8.862=-0.002
σ0.771-0.710=0.061
min7.962-8.162=-0.200
max9.643-9.818=-0.175
iters=5
new-facts=6402
prior-facts=6402
mean5179.045-5188.279=-9.234
σ0.091-0.195=-0.104
min5178.964-5188.010=-9.046
max5179.158-5188.523=-9.366
mean3212.600-3284.200=-71.600
σ351.548-496.906=-145.358
min2715.000-2656.000=59.000
max3642.000-3891.000=-249.000
mean9.932-8.799=1.132
σ0.336-0.118=0.218
min9.611-8.659=0.952
max10.339-8.938=1.401

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.094-1.249=-0.156
σ0.166-0.285=-0.119
min0.932-1.080=-0.147
max1.317-1.741=-0.424

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-464.858=-1.652
σ572.658-572.657=0.001
min176.865-178.525=-1.661
max1322.193-1323.844=-1.651
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2641.000-2656.000=-15.000
σ0.000
min2641.000-2656.000=-15.000
max2641.000-2656.000=-15.000
mean0.546-0.572=-0.026
σ0.519-0.578=-0.059
min0.282-0.278=0.003
max1.325-1.439=-0.115
policies=20
mean1768.946-1785.485=-16.539
σ0.338-0.346=-0.008
min1768.722-1785.249=-16.527
max1769.450-1785.998=-16.549
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2641.000-2656.000=-15.000
σ0.000
min2641.000-2656.000=-15.000
max2641.000-2656.000=-15.000
mean2.758-2.800=-0.042
σ0.015-0.039=-0.023
min2.747-2.778=-0.031
max2.780-2.857=-0.078
policies=200
mean17696.195-17861.377=-165.182
σ0.533-0.121=0.412
min17695.777-17861.301=-165.525
max17696.977-17861.557=-164.580
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2641.000-2656.000=-15.000
σ0.000
min2641.000-2656.000=-15.000
max2641.000-2656.000=-15.000
mean27.667-28.277=-0.610
σ0.103-0.316=-0.214
min27.574-27.981=-0.407
max27.756-28.601=-0.845