Compare commits

Home / Compare c2d9b90b .. 48314c78

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.042=-0.001
σ0.048-0.048=0.000
min31.003-31.000=0.003
max31.175-31.174=0.001
mean414.200-414.000=0.200
σ1.033-0.000=1.033
min413.000-414.000=-1.000
max415.000-414.000=1.000
mean0.077-0.077=0.000
σ0.005-0.004=0.001
min0.071-0.070=0.001
max0.086-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.003=-0.000
min21.138-21.138=0.000
max21.147-21.147=-0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.001
min0.064-0.060=0.004
max0.070-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.411=0.002
σ0.362-0.361=0.001
min1750.838-1750.846=-0.008
max1751.993-1751.986=0.007
mean1639.150-1640.350=-1.200
σ620.322-619.230=1.092
min650.000
max2479.000-2478.000=1.000
mean2.861-2.810=0.051
σ0.104-0.140=-0.036
min2.689-2.466=0.223
max3.071-3.048=0.023

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.075-279.075=0.001
σ0.008-0.011=-0.003
min279.065-279.062=0.003
max279.085-279.086=-0.001
mean2479.000-2478.000=1.000
σ0.000
min2479.000-2478.000=1.000
max2479.000-2478.000=1.000
mean0.401-0.396=0.004
σ0.005-0.009=-0.004
min0.397-0.388=0.009
max0.408-0.409=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1939.515-1939.502=0.013
σ0.016-0.002=0.014
min1939.501-1939.499=0.002
max1939.542-1939.503=0.038
mean2479.000-2478.000=1.000
σ0.000
min2479.000-2478.000=1.000
max2479.000-2478.000=1.000
mean2.939-3.018=-0.079
σ0.269-0.102=0.167
min2.488-2.908=-0.419
max3.198-3.173=0.025
iters=5
new-facts=6402
prior-facts=1
mean4759.922-4759.840=0.082
σ0.949-0.749=0.200
min4759.286-4758.990=0.295
max4761.596-4761.046=0.550
mean2479.000-2478.000=1.000
σ0.000
min2479.000-2478.000=1.000
max2479.000-2478.000=1.000
mean8.369-8.144=0.225
σ0.668-0.594=0.075
min7.811-7.792=0.019
max9.164-9.181=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4950.393-4950.392=0.000
σ0.207-0.203=0.005
min4950.047-4950.058=-0.011
max4950.556-4950.555=0.001
mean2969.000-2937.000=32.000
σ429.439-381.737=47.702
min2479.000-2478.000=1.000
max3553.000-3447.000=106.000
mean8.511-8.413=0.098
σ0.119-0.066=0.053
min8.392-8.311=0.081
max8.679-8.476=0.203

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.813-1.836=-0.023
σ0.061-0.102=-0.041
min1.772-1.704=0.068
max1.913-1.971=-0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.334-463.334=0.000
σ572.193-572.199=-0.005
min177.232-177.233=-0.001
max1321.624-1321.631=-0.008
mean79.750
σ7.500
min76.000
max91.000
mean2479.000-2478.000=1.000
σ0.000
min2479.000-2478.000=1.000
max2479.000-2478.000=1.000
mean0.549-0.567=-0.019
σ0.536-0.571=-0.035
min0.275-0.276=-0.001
max1.352-1.424=-0.071
policies=20
mean1772.588-1772.588=-0.000
σ0.334-0.333=0.002
min1772.370-1772.367=0.003
max1773.085-1773.082=0.002
mean760.000
σ0.000
min760.000
max760.000
mean2479.000-2478.000=1.000
σ0.000
min2479.000-2478.000=1.000
max2479.000-2478.000=1.000
mean2.751-2.743=0.009
σ0.010-0.010=-0.001
min2.742-2.732=0.010
max2.761-2.754=0.007
policies=200
mean17732.523-17732.440=0.084
σ0.506-0.375=0.131
min17732.232-17732.220=0.012
max17733.281-17732.999=0.281
mean7600.000
σ0.000
min7600.000
max7600.000
mean2479.000-2478.000=1.000
σ0.000
min2479.000-2478.000=1.000
max2479.000-2478.000=1.000
mean27.803-27.758=0.045
σ0.151-0.121=0.029
min27.673-27.641=0.032
max28.013-27.928=0.085