Compare commits

Home / Compare 1f79de0c .. 8f401b1b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.855-30.855=0.000
σ0.047-0.047=0.001
min30.832-30.835=-0.003
max30.990-30.988=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.079-0.078=0.001
σ0.003-0.005=-0.002
min0.077-0.070=0.007
max0.085-0.087=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.141-21.141=-0.001
σ0.002-0.004=-0.002
min21.139-21.138=0.001
max21.143-21.148=-0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.062-0.064=-0.002
σ0.004-0.002=0.002
min0.059-0.063=-0.004
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.235=-0.001
σ0.362-0.362=0.000
min1750.668-1750.668=0.000
max1751.824-1751.813=0.011
mean1647.100-1654.450=-7.350
σ619.808-629.932=-10.124
min681.000-688.000=-7.000
max2642.000-2769.000=-127.000
mean2.748-2.752=-0.004
σ0.178-0.219=-0.041
min2.275-2.275=0.000
max2.966-3.102=-0.136

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.568-275.569=-0.001
σ0.008-0.007=0.001
min275.559-275.563=-0.004
max275.578-275.580=-0.003
mean2642.000-2769.000=-127.000
σ0.000
min2642.000-2769.000=-127.000
max2642.000-2769.000=-127.000
mean0.397-0.390=0.007
σ0.009-0.007=0.002
min0.387-0.386=0.001
max0.409-0.403=0.007
iters=5
new-facts=1
prior-facts=6402
mean2168.093-2168.089=0.005
σ0.012-0.014=-0.002
min2168.078-2168.076=0.002
max2168.106-2168.110=-0.004
mean2642.000-2769.000=-127.000
σ0.000
min2642.000-2769.000=-127.000
max2642.000-2769.000=-127.000
mean2.882-3.022=-0.140
σ0.117-0.201=-0.083
min2.687-2.725=-0.038
max3.006-3.168=-0.162
iters=5
new-facts=6402
prior-facts=1
mean5047.923-5047.886=0.037
σ0.981-0.901=0.080
min5047.451-5047.401=0.050
max5049.678-5049.492=0.186
mean2642.000-2769.000=-127.000
σ0.000
min2642.000-2769.000=-127.000
max2642.000-2769.000=-127.000
mean8.907-8.857=0.049
σ0.555-0.354=0.201
min8.199-8.226=-0.027
max9.721-9.048=0.672
iters=5
new-facts=6402
prior-facts=6402
mean5179.046-5179.051=-0.005
σ0.083-0.090=-0.007
min5178.965-5178.962=0.002
max5179.144-5179.151=-0.007
mean3219.600-3250.800=-31.200
σ386.253-355.287=30.965
min2686.000-2769.000=-83.000
max3703.000-3691.000=12.000
mean9.875-9.907=-0.032
σ0.262-0.359=-0.097
min9.574-9.359=0.215
max10.130-10.295=-0.165

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.226-1.090=0.137
σ0.397-0.264=0.132
min0.926-0.939=-0.013
max1.734-1.551=0.183

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.205=-0.002
σ572.659-572.669=-0.009
min176.872-176.868=0.004
max1322.192-1322.208=-0.016
mean77.500
σ7.000
min74.000
max88.000
mean2642.000-2769.000=-127.000
σ0.000
min2642.000-2769.000=-127.000
max2642.000-2769.000=-127.000
mean0.559-0.465=0.094
σ0.562-0.379=0.183
min0.277-0.274=0.003
max1.402-1.034=0.368
policies=20
mean1768.969-1768.971=-0.003
σ0.336-0.319=0.017
min1768.750-1768.752=-0.002
max1769.469-1769.444=0.024
mean740.000
σ0.000
min740.000
max740.000
mean2642.000-2769.000=-127.000
σ0.000
min2642.000-2769.000=-127.000
max2642.000-2769.000=-127.000
mean2.745-2.731=0.014
σ0.025-0.007=0.018
min2.716-2.724=-0.008
max2.777-2.740=0.037
policies=200
mean17696.026-17695.981=0.046
σ0.578-0.520=0.058
min17695.351-17695.632=-0.281
max17696.760-17696.740=0.020
mean7400.000
σ0.000
min7400.000
max7400.000
mean2642.000-2769.000=-127.000
σ0.000
min2642.000-2769.000=-127.000
max2642.000-2769.000=-127.000
mean27.597-27.654=-0.057
σ0.134-0.072=0.062
min27.424-27.550=-0.126
max27.724-27.710=0.014