Compare commits

Home / Compare f889cfa8 .. 6dc26adb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.770-30.770=-0.000
σ0.047-0.048=-0.001
min30.729-30.726=0.003
max30.898-30.899=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.077-0.077=-0.000
σ0.004-0.004=-0.000
min0.071-0.072=-0.001
max0.084-0.084=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.061-21.061=0.000
σ0.002-0.002=0.001
min21.058-21.058=-0.000
max21.065-21.064=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.064-0.064=0.000
σ0.002-0.002=-0.000
min0.063-0.062=0.001
max0.069-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.420=-0.000
σ0.359-0.363=-0.004
min1750.856-1750.853=0.002
max1752.004-1752.020=-0.016
mean1661.350-1658.650=2.700
σ625.830-645.946=-20.116
min657.000-635.000=22.000
max2513.000-2862.000=-349.000
mean2.828-2.827=0.001
σ0.144-0.178=-0.035
min2.451-2.323=0.127
max3.154-3.086=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.754-275.753=0.001
σ0.010-0.005=0.004
min275.743-275.745=-0.002
max275.765-275.759=0.006
mean2513.000-2862.000=-349.000
σ0.000
min2513.000-2862.000=-349.000
max2513.000-2862.000=-349.000
mean0.392-0.395=-0.003
σ0.006-0.012=-0.007
min0.387-0.385=0.002
max0.400-0.412=-0.011
iters=5
new-facts=1
prior-facts=6402
mean2168.271-2168.276=-0.006
σ0.011-0.015=-0.004
min2168.258-2168.262=-0.004
max2168.285-2168.294=-0.008
mean2513.000-2862.000=-349.000
σ0.000
min2513.000-2862.000=-349.000
max2513.000-2862.000=-349.000
mean2.858-2.877=-0.018
σ0.097-0.094=0.004
min2.773-2.786=-0.013
max2.971-2.981=-0.010
iters=5
new-facts=6402
prior-facts=1
mean5048.110-5048.135=-0.025
σ0.958-0.880=0.078
min5047.533-5047.527=0.006
max5049.814-5049.690=0.124
mean2513.000-2862.000=-349.000
σ0.000
min2513.000-2862.000=-349.000
max2513.000-2862.000=-349.000
mean8.847-8.661=0.186
σ0.561-0.493=0.068
min8.007-8.115=-0.108
max9.468-9.386=0.082
iters=5
new-facts=6402
prior-facts=6402
mean5179.237-5179.148=0.088
σ0.091-0.209=-0.118
min5179.158-5178.807=0.351
max5179.345-5179.319=0.026
mean3268.400-3318.000=-49.600
σ508.844-454.622=54.222
min2647.000-2862.000=-215.000
max3955.000-3969.000=-14.000
mean10.027-9.738=0.290
σ0.110-0.373=-0.263
min9.932-9.077=0.855
max10.178-9.943=0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.740-1.086=0.654
σ0.136-0.231=-0.095
min1.526-0.952=0.574
max1.853-1.488=0.365

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.568-463.578=-0.010
σ572.653-572.661=-0.008
min177.239-177.240=-0.001
max1322.547-1322.569=-0.022
mean79.750
σ7.500
min76.000
max91.000
mean2513.000-2862.000=-349.000
σ0.000
min2513.000-2862.000=-349.000
max2513.000-2862.000=-349.000
mean0.561-0.441=0.120
σ0.567-0.304=0.264
min0.275-0.284=-0.009
max1.412-0.896=0.516
policies=20
mean1772.640-1772.693=-0.053
σ0.331-0.342=-0.011
min1772.412-1772.435=-0.023
max1773.130-1773.192=-0.062
mean760.000
σ0.000
min760.000
max760.000
mean2513.000-2862.000=-349.000
σ0.000
min2513.000-2862.000=-349.000
max2513.000-2862.000=-349.000
mean2.775-2.871=-0.096
σ0.069-0.025=0.044
min2.716-2.835=-0.119
max2.871-2.887=-0.016
policies=200
mean17733.030-17733.108=-0.078
σ0.453-0.473=-0.020
min17732.742-17732.760=-0.018
max17733.704-17733.799=-0.095
mean7600.000
σ0.000
min7600.000
max7600.000
mean2513.000-2862.000=-349.000
σ0.000
min2513.000-2862.000=-349.000
max2513.000-2862.000=-349.000
mean27.671-28.232=-0.562
σ0.104-0.551=-0.448
min27.616-27.675=-0.059
max27.826-28.845=-1.019