Compare commits

Home / Compare 23e19aae .. fd1bf22a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.774-30.772=0.002
σ0.048-0.046=0.002
min30.746-30.748=-0.003
max30.909-30.901=0.008
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.077-0.072=0.005
σ0.005-0.008=-0.003
min0.070-0.059=0.011
max0.086-0.083=0.003
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.000
σ0.003-0.003=0.000
min21.055-21.055=-0.000
max21.063-21.064=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.063=0.002
σ0.003-0.004=-0.001
min0.062-0.057=0.006
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.233=0.002
σ0.363-0.366=-0.003
min1750.667-1750.672=-0.004
max1751.819-1751.821=-0.003
mean1646.000-1648.150=-2.150
σ619.976-619.549=0.428
min680.000-682.000=-2.000
max2638.000-2643.000=-5.000
mean2.816-2.798=0.018
σ0.156-0.190=-0.034
min2.379-2.299=0.080
max3.004-3.140=-0.136

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.564-275.566=-0.001
σ0.003-0.004=-0.001
min275.560-275.559=0.001
max275.568-275.569=-0.001
mean2638.000-2643.000=-5.000
σ0.000
min2638.000-2643.000=-5.000
max2638.000-2643.000=-5.000
mean0.393-0.392=0.001
σ0.009-0.007=0.002
min0.386-0.387=-0.001
max0.405-0.401=0.004
iters=5
new-facts=1
prior-facts=6402
mean2168.089-2168.102=-0.012
σ0.022-0.009=0.013
min2168.051-2168.089=-0.038
max2168.104-2168.114=-0.010
mean2638.000-2643.000=-5.000
σ0.000
min2638.000-2643.000=-5.000
max2638.000-2643.000=-5.000
mean2.950-2.830=0.120
σ0.198-0.119=0.079
min2.622-2.680=-0.058
max3.152-2.969=0.183
iters=5
new-facts=6402
prior-facts=1
mean5047.780-5047.894=-0.114
σ0.646-0.908=-0.262
min5047.382-5047.374=0.008
max5048.919-5049.507=-0.587
mean2638.000-2643.000=-5.000
σ0.000
min2638.000-2643.000=-5.000
max2638.000-2643.000=-5.000
mean8.873-8.850=0.023
σ0.559-0.452=0.106
min7.916-8.084=-0.168
max9.385-9.284=0.100
iters=5
new-facts=6402
prior-facts=6402
mean5179.038-5179.027=0.012
σ0.089-0.087=0.002
min5178.969-5178.942=0.027
max5179.155-5179.123=0.032
mean3215.800-3207.600=8.200
σ385.700-485.494=-99.794
min2684.000-2643.000=41.000
max3699.000-3864.000=-165.000
mean9.468-9.609=-0.141
σ0.617-0.610=0.006
min8.688-8.635=0.053
max10.143-10.197=-0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.157-1.182=-0.026
σ0.163-0.270=-0.107
min0.962-0.959=0.002
max1.381-1.606=-0.225

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.209-463.203=0.005
σ572.673-572.663=0.011
min176.867-176.869=-0.002
max1322.219-1322.197=0.021
mean77.500
σ7.000
min74.000
max88.000
mean2638.000-2643.000=-5.000
σ0.000
min2638.000-2643.000=-5.000
max2638.000-2643.000=-5.000
mean0.539-0.560=-0.021
σ0.525-0.564=-0.039
min0.271-0.277=-0.006
max1.326-1.405=-0.080
policies=20
mean1768.959-1768.973=-0.014
σ0.336-0.340=-0.004
min1768.763-1768.759=0.003
max1769.462-1769.480=-0.019
mean740.000
σ0.000
min740.000
max740.000
mean2638.000-2643.000=-5.000
σ0.000
min2638.000-2643.000=-5.000
max2638.000-2643.000=-5.000
mean2.756-2.745=0.011
σ0.034-0.030=0.005
min2.726-2.712=0.014
max2.801-2.772=0.029
policies=200
mean17696.152-17696.254=-0.102
σ0.624-0.470=0.155
min17695.576-17696.014=-0.438
max17697.040-17696.958=0.082
mean7400.000
σ0.000
min7400.000
max7400.000
mean2638.000-2643.000=-5.000
σ0.000
min2638.000-2643.000=-5.000
max2638.000-2643.000=-5.000
mean27.665-27.667=-0.003
σ0.216-0.136=0.080
min27.486-27.517=-0.030
max27.952-27.836=0.116