Compare commits

Home / Compare 908eb2da .. 11563412

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.773=-0.000
σ0.046-0.046=0.000
min30.751-30.752=-0.001
max30.902-30.902=-0.000
mean412.800-416.000=-3.200
σ0.422-0.000=0.422
min412.000-416.000=-4.000
max413.000-416.000=-3.000
mean0.074-0.079=-0.005
σ0.004-0.004=0.000
min0.069-0.076=-0.006
max0.081-0.088=-0.007
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.000
σ0.002-0.002=-0.000
min21.055-21.056=-0.001
max21.063-21.063=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.064-0.064=-0.000
σ0.003-0.002=0.000
min0.062-0.063=-0.001
max0.071-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.237=-0.002
σ0.362-0.363=-0.000
min1750.671-1750.671=0.001
max1751.821-1751.810=0.010
mean1666.300-1654.150=12.150
σ639.301-640.100=-0.799
min680.000-653.000=27.000
max2697.000-2849.000=-152.000
mean2.831-2.905=-0.074
σ0.150-0.105=0.046
min2.289-2.731=-0.442
max3.004-3.206=-0.202

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.567-275.573=-0.006
σ0.005-0.008=-0.003
min275.558-275.565=-0.007
max275.572-275.584=-0.012
mean2697.000-2849.000=-152.000
σ0.000
min2697.000-2849.000=-152.000
max2697.000-2849.000=-152.000
mean0.395-0.403=-0.008
σ0.007-0.012=-0.005
min0.384-0.394=-0.010
max0.401-0.419=-0.018
iters=5
new-facts=1
prior-facts=6402
mean2168.101-2168.095=0.006
σ0.008-0.009=-0.001
min2168.091-2168.085=0.006
max2168.111-2168.105=0.007
mean2697.000-2849.000=-152.000
σ0.000
min2697.000-2849.000=-152.000
max2697.000-2849.000=-152.000
mean2.919-2.945=-0.026
σ0.147-0.148=-0.001
min2.719-2.810=-0.091
max3.085-3.158=-0.073
iters=5
new-facts=6402
prior-facts=1
mean5047.774-5047.923=-0.148
σ0.631-0.895=-0.264
min5047.380-5047.363=0.017
max5048.895-5049.512=-0.617
mean2697.000-2849.000=-152.000
σ0.000
min2697.000-2849.000=-152.000
max2697.000-2849.000=-152.000
mean8.741-8.799=-0.058
σ0.393-0.520=-0.128
min8.109-8.025=0.084
max9.069-9.405=-0.336
iters=5
new-facts=6402
prior-facts=6402
mean5178.978-5179.052=-0.074
σ0.216-0.088=0.128
min5178.617-5178.969=-0.352
max5179.149-5179.162=-0.013
mean3221.800-3250.200=-28.400
σ381.561-332.426=49.135
min2697.000-2849.000=-152.000
max3701.000-3699.000=2.000
mean9.827-9.975=-0.148
σ0.334-0.268=0.066
min9.511-9.564=-0.054
max10.267-10.281=-0.013

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.109-1.161=-0.052
σ0.178-0.303=-0.124
min0.939-0.931=0.008
max1.330-1.528=-0.197

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.201-463.210=-0.009
σ572.662-572.662=-0.001
min176.866-176.871=-0.005
max1322.194-1322.204=-0.010
mean77.500
σ7.000
min74.000
max88.000
mean2697.000-2849.000=-152.000
σ0.000
min2697.000-2849.000=-152.000
max2697.000-2849.000=-152.000
mean0.550-0.439=0.111
σ0.550-0.304=0.246
min0.272-0.282=-0.010
max1.374-0.895=0.479
policies=20
mean1768.939-1769.001=-0.062
σ0.333-0.336=-0.003
min1768.725-1768.773=-0.048
max1769.436-1769.498=-0.062
mean740.000
σ0.000
min740.000
max740.000
mean2697.000-2849.000=-152.000
σ0.000
min2697.000-2849.000=-152.000
max2697.000-2849.000=-152.000
mean2.729-2.832=-0.104
σ0.023-0.025=-0.003
min2.707-2.816=-0.109
max2.754-2.870=-0.116
policies=200
mean17696.249-17696.293=-0.044
σ0.517-0.467=0.050
min17695.966-17695.967=-0.001
max17697.023-17696.981=0.042
mean7400.000
σ0.000
min7400.000
max7400.000
mean2697.000-2849.000=-152.000
σ0.000
min2697.000-2849.000=-152.000
max2697.000-2849.000=-152.000
mean27.493-28.082=-0.589
σ0.094-0.480=-0.386
min27.355-27.479=-0.124
max27.555-28.540=-0.985