Compare commits

Home / Compare 3df351c8 .. 057d8501

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.699-70.697=0.001
σ0.048-0.046=0.002
min70.666-70.663=0.003
max70.833-70.824=0.009
mean412.000-412.100=-0.100
σ0.000-0.316=-0.316
min412.000
max412.000-413.000=-1.000
mean0.163-0.158=0.004
σ0.003-0.005=-0.002
min0.159-0.150=0.009
max0.170-0.167=0.003
cache=y
dps=1
iters=10
policies=100
mean21.408-21.408=0.000
σ0.004-0.002=0.002
min21.400-21.405=-0.006
max21.413-21.412=0.002
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.065-0.065=0.001
σ0.002-0.003=-0.001
min0.064-0.061=0.003
max0.071-0.073=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.896-1754.897=-0.001
σ0.361-0.361=0.000
min1754.324-1754.332=-0.009
max1755.477-1755.478=-0.001
mean1655.700-1666.700=-11.000
σ629.007-643.199=-14.193
min681.000-677.000=4.000
max2691.000-2705.000=-14.000
mean2.812-2.814=-0.002
σ0.194-0.183=0.012
min2.349-2.294=0.054
max3.148-3.070=0.079

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.762-272.756=0.005
σ0.008-0.008=-0.000
min272.750-272.746=0.004
max272.770-272.766=0.004
mean2691.000-2705.000=-14.000
σ0.000
min2691.000-2705.000=-14.000
max2691.000-2705.000=-14.000
mean0.383-0.387=-0.004
σ0.002-0.005=-0.003
min0.381-0.381=-0.000
max0.386-0.392=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1933.134-1933.134=-0.000
σ0.012-0.016=-0.004
min1933.124-1933.118=0.006
max1933.154-1933.161=-0.006
mean2691.000-2705.000=-14.000
σ0.000
min2691.000-2705.000=-14.000
max2691.000-2705.000=-14.000
mean2.928-2.990=-0.062
σ0.223-0.278=-0.056
min2.533-2.525=0.008
max3.049-3.206=-0.157
iters=5
new-facts=6402
prior-facts=1
mean4753.942-4753.852=0.090
σ0.935-0.660=0.275
min4753.340-4753.349=-0.009
max4755.601-4755.011=0.589
mean2691.000-2705.000=-14.000
σ0.000
min2691.000-2705.000=-14.000
max2691.000-2705.000=-14.000
mean8.396-8.121=0.275
σ0.612-0.574=0.038
min7.832-7.746=0.087
max9.329-9.109=0.220
iters=5
new-facts=6402
prior-facts=6402
mean4944.294-4944.371=-0.077
σ0.149-0.022=0.127
min4944.029-4944.347=-0.318
max4944.383-4944.399=-0.015
mean2988.800-2983.000=5.800
σ332.410-320.504=11.906
min2691.000-2705.000=-14.000
max3460.000-3446.000=14.000
mean8.465-8.522=-0.057
σ0.115-0.167=-0.053
min8.394-8.370=0.024
max8.669-8.703=-0.034

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.112-1.047=0.065
σ0.196-0.152=0.044
min0.931-0.929=0.002
max1.376-1.247=0.129

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.642-468.641=0.000
σ574.890-574.894=-0.004
min181.187-181.187=0.000
max1330.976-1330.982=-0.005
mean88.250
σ8.500
min84.000
max101.000
mean2691.000-2705.000=-14.000
σ0.000
min2691.000-2705.000=-14.000
max2691.000-2705.000=-14.000
mean0.571-0.546=0.024
σ0.563-0.545=0.019
min0.288-0.236=0.052
max1.416-1.362=0.053
policies=20
mean1812.195-1812.189=0.006
σ0.382-0.385=-0.003
min1811.933-1811.935=-0.003
max1812.753-1812.760=-0.007
mean840.000
σ0.000
min840.000
max840.000
mean2691.000-2705.000=-14.000
σ0.000
min2691.000-2705.000=-14.000
max2691.000-2705.000=-14.000
mean2.898-2.841=0.057
σ0.048-0.018=0.030
min2.838-2.816=0.023
max2.939-2.858=0.082
policies=200
mean18129.210-18129.085=0.125
σ0.525-0.486=0.039
min18128.780-18128.801=-0.021
max18129.976-18129.813=0.163
mean8400.000
σ0.000
min8400.000
max8400.000
mean2691.000-2705.000=-14.000
σ0.000
min2691.000-2705.000=-14.000
max2691.000-2705.000=-14.000
mean28.701-28.585=0.115
σ0.058-0.018=0.040
min28.640-28.572=0.067
max28.778-28.612=0.166