Compare commits

Home / Compare 750ee35a .. 9f94bcea

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.958=0.083
σ0.052-0.051=0.000
min31.002-30.919=0.083
max31.185-31.100=0.084
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.076-0.076=-0.000
σ0.005-0.005=-0.000
min0.071-0.069=0.001
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.060=0.082
σ0.003-0.002=0.001
min21.138-21.057=0.080
max21.146-21.064=0.083
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.063-0.062=0.000
σ0.005-0.003=0.002
min0.058-0.057=0.000
max0.072-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.414-1751.411=0.002
σ0.361-0.360=0.002
min1750.849-1750.845=0.004
max1751.998-1751.995=0.003
mean1664.600-1660.300=4.300
σ622.945-617.266=5.679
min641.000-640.000=1.000
max2513.000-2490.000=23.000
mean2.861-2.865=-0.003
σ0.102-0.114=-0.012
min2.626-2.590=0.036
max3.089-3.110=-0.021

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.073-279.073=-0.001
σ0.009-0.009=0.000
min279.062-279.061=0.001
max279.083-279.083=-0.000
mean2513.000-2490.000=23.000
σ0.000
min2513.000-2490.000=23.000
max2513.000-2490.000=23.000
mean0.391-0.391=-0.001
σ0.004-0.004=-0.000
min0.386-0.386=0.000
max0.395-0.396=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1939.510-1939.511=-0.001
σ0.005-0.009=-0.004
min1939.505-1939.500=0.005
max1939.517-1939.523=-0.007
mean2513.000-2490.000=23.000
σ0.000
min2513.000-2490.000=23.000
max2513.000-2490.000=23.000
mean3.050-3.037=0.013
σ0.078-0.061=0.017
min2.972-2.977=-0.006
max3.167-3.137=0.030
iters=5
new-facts=6402
prior-facts=1
mean4759.933-4760.008=-0.075
σ0.980-0.858=0.123
min4759.067-4759.529=-0.462
max4761.621-4761.537=0.084
mean2513.000-2490.000=23.000
σ0.000
min2513.000-2490.000=23.000
max2513.000-2490.000=23.000
mean8.282-8.585=-0.303
σ0.605-0.494=0.111
min7.686-7.806=-0.120
max9.254-9.047=0.206
iters=5
new-facts=6402
prior-facts=6402
mean4950.466-4950.470=-0.004
σ0.075-0.078=-0.003
min4950.405-4950.406=-0.001
max4950.548-4950.560=-0.012
mean2976.800-2934.600=42.200
σ420.091-390.833=29.258
min2513.000-2490.000=23.000
max3550.000-3465.000=85.000
mean8.459-8.515=-0.056
σ0.129-0.240=-0.111
min8.355-8.376=-0.021
max8.684-8.936=-0.252

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.797-1.754=0.043
σ0.114-0.199=-0.085
min1.644-1.446=0.198
max1.898-1.916=-0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.328-463.332=-0.003
σ572.195-572.196=-0.002
min177.228-177.233=-0.005
max1321.620-1321.626=-0.006
mean79.750
σ7.500
min76.000
max91.000
mean2513.000-2490.000=23.000
σ0.000
min2513.000-2490.000=23.000
max2513.000-2490.000=23.000
mean0.551-0.559=-0.008
σ0.542-0.560=-0.017
min0.277-0.272=0.005
max1.364-1.399=-0.034
policies=20
mean1772.564-1772.587=-0.023
σ0.335-0.335=0.001
min1772.342-1772.365=-0.022
max1773.062-1773.083=-0.021
mean760.000
σ0.000
min760.000
max760.000
mean2513.000-2490.000=23.000
σ0.000
min2513.000-2490.000=23.000
max2513.000-2490.000=23.000
mean2.756-2.746=0.011
σ0.026-0.012=0.014
min2.729-2.733=-0.005
max2.782-2.757=0.025
policies=200
mean17732.474-17732.509=-0.035
σ0.504-0.505=-0.001
min17732.071-17732.228=-0.157
max17733.207-17733.266=-0.059
mean7600.000
σ0.000
min7600.000
max7600.000
mean2513.000-2490.000=23.000
σ0.000
min2513.000-2490.000=23.000
max2513.000-2490.000=23.000
mean27.685-27.684=0.001
σ0.142-0.154=-0.011
min27.511-27.568=-0.057
max27.810-27.903=-0.093