Compare commits

Home / Compare 51bfafae .. 6857858e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.705-70.787=-0.083
σ0.047-0.045=0.002
min70.672-70.756=-0.084
max70.834-70.912=-0.078
mean412.000-412.400=-0.400
σ0.000-0.516=-0.516
min412.000
max412.000-413.000=-1.000
mean0.158-0.159=-0.001
σ0.006-0.004=0.001
min0.150-0.149=0.002
max0.168-0.165=0.003
cache=y
dps=1
iters=10
policies=100
mean21.413-21.496=-0.083
σ0.002-0.002=-0.000
min21.409-21.493=-0.083
max21.415-21.500=-0.084
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.064-0.065=-0.001
σ0.004-0.002=0.001
min0.059-0.063=-0.004
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.934-1754.092=0.842
σ0.361-0.362=-0.001
min1754.360-1753.525=0.835
max1755.513-1754.679=0.834
mean1657.500-1634.500=23.000
σ624.670-611.818=12.853
min681.000-643.000=38.000
max2771.000-2456.000=315.000
mean2.861-2.766=0.095
σ0.073-0.174=-0.101
min2.731-2.299=0.432
max3.007-3.095=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.793-271.924=0.869
σ0.007-0.008=-0.000
min272.786-271.917=0.869
max272.803-271.936=0.867
mean2771.000-2456.000=315.000
σ0.000
min2771.000-2456.000=315.000
max2771.000-2456.000=315.000
mean0.383-0.385=-0.002
σ0.006-0.011=-0.005
min0.379-0.379=-0.000
max0.394-0.405=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.226-1932.326=0.901
σ0.019-0.005=0.013
min1933.196-1932.321=0.875
max1933.246-1932.335=0.911
mean2771.000-2456.000=315.000
σ0.000
min2771.000-2456.000=315.000
max2771.000-2456.000=315.000
mean3.010-3.002=0.008
σ0.331-0.108=0.223
min2.469-2.866=-0.397
max3.372-3.166=0.206
iters=5
new-facts=6402
prior-facts=1
mean4756.885-4753.138=3.747
σ7.619-0.850=6.769
min4753.121-4752.633=0.488
max4770.509-4754.652=15.857
mean2771.000-2456.000=315.000
σ0.000
min2771.000-2456.000=315.000
max2771.000-2456.000=315.000
mean8.279-8.313=-0.034
σ0.482-0.502=-0.020
min7.627-7.592=0.035
max8.886-8.877=0.009
iters=5
new-facts=6402
prior-facts=6402
mean4944.382-4943.483=0.899
σ0.153-0.167=-0.014
min4944.108-4943.187=0.922
max4944.460-4943.585=0.876
mean3019.800-2993.600=26.200
σ310.666-287.351=23.314
min2771.000-2597.000=174.000
max3497.000-3334.000=163.000
mean8.564-8.487=0.078
σ0.372-0.110=0.262
min8.350-8.345=0.005
max9.222-8.642=0.580

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.977-1.727=-0.750
σ0.138-0.198=-0.060
min0.912-1.491=-0.579
max1.224-1.976=-0.751

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.337-468.658=-0.322
σ574.259-574.926=-0.667
min181.203-181.190=0.013
max1329.726-1331.048=-1.322
mean88.250
σ8.500
min84.000
max101.000
mean2771.000-2456.000=315.000
σ0.000
min2771.000-2456.000=315.000
max2771.000-2456.000=315.000
mean0.444-0.575=-0.130
σ0.306-0.574=-0.269
min0.289-0.284=0.005
max0.903-1.436=-0.534
policies=20
mean1812.353-1812.217=0.136
σ0.387-0.394=-0.007
min1812.091-1811.954=0.137
max1812.923-1812.800=0.123
mean840.000
σ0.000
min840.000
max840.000
mean2771.000-2456.000=315.000
σ0.000
min2771.000-2456.000=315.000
max2771.000-2456.000=315.000
mean2.884-2.846=0.038
σ0.003-0.013=-0.011
min2.881-2.832=0.049
max2.887-2.863=0.024
policies=200
mean18129.207-18129.359=-0.152
σ0.481-0.492=-0.011
min18128.774-18129.092=-0.318
max18129.894-18130.096=-0.202
mean8400.000
σ0.000
min8400.000
max8400.000
mean2771.000-2456.000=315.000
σ0.000
min2771.000-2456.000=315.000
max2771.000-2456.000=315.000
mean28.464-28.651=-0.187
σ0.248-0.110=0.139
min28.268-28.543=-0.275
max28.825-28.787=0.038