Compare commits

Home / Compare bcdc83e5 .. 2ef96f1d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.772=-0.001
σ0.049-0.046=0.003
min30.745-30.748=-0.003
max30.909-30.901=0.007
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.079-0.072=0.007
σ0.003-0.008=-0.005
min0.075-0.059=0.017
max0.083-0.083=0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.001
σ0.002-0.003=-0.001
min21.057-21.055=0.003
max21.063-21.064=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.062-0.063=-0.001
σ0.004-0.004=0.000
min0.057-0.057=-0.000
max0.070-0.071=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.237-1751.233=0.003
σ0.364-0.366=-0.002
min1750.668-1750.672=-0.004
max1751.841-1751.821=0.020
mean1657.850-1648.150=9.700
σ637.648-619.549=18.099
min620.000-682.000=-62.000
max2809.000-2643.000=166.000
mean2.795-2.798=-0.003
σ0.259-0.190=0.069
min2.361-2.299=0.062
max3.375-3.140=0.235

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.562-275.566=-0.004
σ0.006-0.004=0.002
min275.555-275.559=-0.004
max275.570-275.569=0.001
mean2809.000-2643.000=166.000
σ0.000
min2809.000-2643.000=166.000
max2809.000-2643.000=166.000
mean0.404-0.392=0.012
σ0.008-0.007=0.001
min0.395-0.387=0.008
max0.414-0.401=0.012
iters=5
new-facts=1
prior-facts=6402
mean2168.091-2168.102=-0.011
σ0.006-0.009=-0.003
min2168.082-2168.089=-0.007
max2168.097-2168.114=-0.018
mean2809.000-2643.000=166.000
σ0.000
min2809.000-2643.000=166.000
max2809.000-2643.000=166.000
mean2.950-2.830=0.120
σ0.157-0.119=0.038
min2.745-2.680=0.065
max3.154-2.969=0.186
iters=5
new-facts=6402
prior-facts=1
mean5047.670-5047.894=-0.223
σ1.043-0.908=0.135
min5046.954-5047.374=-0.420
max5049.492-5049.507=-0.015
mean2809.000-2643.000=166.000
σ0.000
min2809.000-2643.000=166.000
max2809.000-2643.000=166.000
mean8.796-8.850=-0.054
σ0.503-0.452=0.050
min8.010-8.084=-0.074
max9.302-9.284=0.018
iters=5
new-facts=6402
prior-facts=6402
mean5178.972-5179.027=-0.054
σ0.216-0.087=0.129
min5178.612-5178.942=-0.330
max5179.141-5179.123=0.017
mean3241.200-3207.600=33.600
σ347.134-485.494=-138.360
min2809.000-2643.000=166.000
max3702.000-3864.000=-162.000
mean10.003-9.609=0.394
σ0.261-0.610=-0.349
min9.640-8.635=1.005
max10.373-10.197=0.176

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.011-1.182=-0.171
σ0.141-0.270=-0.129
min0.943-0.959=-0.016
max1.263-1.606=-0.343

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.206-463.203=0.003
σ572.650-572.663=-0.012
min176.870-176.869=0.001
max1322.181-1322.197=-0.016
mean77.500
σ7.000
min74.000
max88.000
mean2809.000-2643.000=166.000
σ0.000
min2809.000-2643.000=166.000
max2809.000-2643.000=166.000
mean0.441-0.560=-0.119
σ0.308-0.564=-0.256
min0.285-0.277=0.008
max0.903-1.405=-0.503
policies=20
mean1769.011-1768.973=0.038
σ0.329-0.340=-0.011
min1768.790-1768.759=0.031
max1769.497-1769.480=0.017
mean740.000
σ0.000
min740.000
max740.000
mean2809.000-2643.000=166.000
σ0.000
min2809.000-2643.000=166.000
max2809.000-2643.000=166.000
mean2.810-2.745=0.065
σ0.118-0.030=0.088
min2.723-2.712=0.011
max2.982-2.772=0.210
policies=200
mean17696.244-17696.254=-0.010
σ0.483-0.470=0.013
min17695.979-17696.014=-0.035
max17696.967-17696.958=0.009
mean7400.000
σ0.000
min7400.000
max7400.000
mean2809.000-2643.000=166.000
σ0.000
min2809.000-2643.000=166.000
max2809.000-2643.000=166.000
mean27.659-27.667=-0.008
σ0.172-0.136=0.036
min27.513-27.517=-0.004
max27.865-27.836=0.029