Compare commits

Home / Compare 8b9615d0 .. d77477a7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.773=-0.000
σ0.047-0.046=0.001
min30.750-30.752=-0.002
max30.907-30.904=0.003
mean414.000-410.000=4.000
σ0.000
min414.000-410.000=4.000
max414.000-410.000=4.000
mean0.079-0.079=0.000
σ0.004-0.004=0.000
min0.076-0.076=0.000
max0.087-0.086=0.001
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=0.000
σ0.003-0.002=0.001
min21.054-21.056=-0.002
max21.065-21.062=0.003
mean414.000-410.000=4.000
σ0.000
min414.000-410.000=4.000
max414.000-410.000=4.000
mean0.061-0.062=-0.001
σ0.002-0.004=-0.001
min0.057-0.057=0.000
max0.065-0.069=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.237=-0.000
σ0.364-0.363=0.000
min1750.671-1750.669=0.002
max1751.823-1751.822=0.002
mean1668.950-1644.200=24.750
σ639.428-619.928=19.500
min682.000-677.000=5.000
max2699.000-2641.000=58.000
mean2.875-2.822=0.053
σ0.145-0.192=-0.047
min2.357-2.299=0.058
max3.042-3.269=-0.227

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.566-275.569=-0.003
σ0.003-0.008=-0.004
min275.563-275.563=0.000
max275.571-275.582=-0.011
mean2699.000-2641.000=58.000
σ0.000
min2699.000-2641.000=58.000
max2699.000-2641.000=58.000
mean0.392-0.391=0.001
σ0.009-0.005=0.004
min0.385-0.387=-0.002
max0.404-0.397=0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.086-2168.096=-0.010
σ0.026-0.013=0.014
min2168.043-2168.083=-0.040
max2168.111-2168.116=-0.005
mean2699.000-2641.000=58.000
σ0.000
min2699.000-2641.000=58.000
max2699.000-2641.000=58.000
mean3.014-2.926=0.088
σ0.161-0.119=0.042
min2.804-2.784=0.020
max3.198-3.107=0.092
iters=5
new-facts=6402
prior-facts=1
mean5047.673-5047.721=-0.049
σ1.065-0.763=0.302
min5046.565-5047.072=-0.507
max5049.449-5049.036=0.412
mean2699.000-2641.000=58.000
σ0.000
min2699.000-2641.000=58.000
max2699.000-2641.000=58.000
mean8.812-8.861=-0.049
σ0.521-0.771=-0.250
min8.076-7.962=0.114
max9.478-9.643=-0.165
iters=5
new-facts=6402
prior-facts=6402
mean5179.049-5179.045=0.004
σ0.107-0.091=0.015
min5178.965-5178.964=0.001
max5179.177-5179.158=0.019
mean3230.400-3212.600=17.800
σ386.896-351.548=35.349
min2699.000-2715.000=-16.000
max3718.000-3642.000=76.000
mean10.101-9.932=0.170
σ0.351-0.336=0.015
min9.764-9.611=0.153
max10.687-10.339=0.348

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.075-1.094=-0.018
σ0.133-0.166=-0.034
min0.942-0.932=0.010
max1.214-1.317=-0.103

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.204-463.206=-0.003
σ572.658-572.658=0.000
min176.863-176.865=-0.002
max1322.191-1322.193=-0.002
mean77.500
σ7.000
min74.000
max88.000
mean2699.000-2641.000=58.000
σ0.000
min2699.000-2641.000=58.000
max2699.000-2641.000=58.000
mean0.561-0.546=0.015
σ0.564-0.519=0.045
min0.276-0.282=-0.006
max1.406-1.325=0.082
policies=20
mean1768.945-1768.946=-0.001
σ0.336-0.338=-0.002
min1768.727-1768.722=0.005
max1769.446-1769.450=-0.003
mean740.000
σ0.000
min740.000
max740.000
mean2699.000-2641.000=58.000
σ0.000
min2699.000-2641.000=58.000
max2699.000-2641.000=58.000
mean2.742-2.758=-0.015
σ0.003-0.015=-0.012
min2.738-2.747=-0.009
max2.746-2.780=-0.034
policies=200
mean17696.221-17696.195=0.026
σ0.536-0.533=0.003
min17695.940-17695.777=0.164
max17697.024-17696.977=0.047
mean7400.000
σ0.000
min7400.000
max7400.000
mean2699.000-2641.000=58.000
σ0.000
min2699.000-2641.000=58.000
max2699.000-2641.000=58.000
mean27.759-27.667=0.092
σ0.098-0.103=-0.005
min27.667-27.574=0.093
max27.862-27.756=0.106