Compare commits

Home / Compare fd10bb4f .. 1c03e482

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.000
σ0.049-0.048=0.001
min33.950-33.951=-0.001
max34.115-34.112=0.003
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.084-0.084=0.000
σ0.003-0.003=-0.000
min0.082-0.082=-0.000
max0.090-0.091=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=-0.001
σ0.002-0.003=-0.001
min23.312-23.312=0.000
max23.320-23.322=-0.002
mean414.000-415.000=-1.000
σ0.000
min414.000-415.000=-1.000
max414.000-415.000=-1.000
mean0.065-0.065=0.001
σ0.002-0.003=-0.000
min0.064-0.060=0.004
max0.072-0.071=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.302-1757.303=-0.002
σ0.365-0.364=0.001
min1756.729-1756.728=0.002
max1757.867-1757.889=-0.022
mean1639.950-1663.650=-23.700
σ623.159-627.050=-3.891
min623.000-669.000=-46.000
max2691.000-2610.000=81.000
mean2.394-2.367=0.027
σ0.123-0.104=0.019
min2.249-2.265=-0.016
max2.682-2.701=-0.019

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.440-326.442=-0.002
σ0.060-0.053=0.007
min326.334-326.347=-0.013
max326.476-326.469=0.007
mean2691.000-2610.000=81.000
σ0.000
min2691.000-2610.000=81.000
max2691.000-2610.000=81.000
mean0.427-0.428=-0.001
σ0.005-0.002=0.003
min0.424-0.426=-0.002
max0.436-0.431=0.004
iters=5
new-facts=1
prior-facts=6402
mean1988.616-1988.612=0.004
σ0.012-0.012=-0.000
min1988.596-1988.598=-0.002
max1988.629-1988.623=0.006
mean2691.000-2610.000=81.000
σ0.000
min2691.000-2610.000=81.000
max2691.000-2610.000=81.000
mean2.690-2.693=-0.003
σ0.060-0.080=-0.021
min2.641-2.596=0.045
max2.783-2.817=-0.034
iters=5
new-facts=6402
prior-facts=1
mean4813.495-4813.342=0.153
σ7.702-7.800=-0.098
min4809.912-4809.449=0.463
max4827.271-4827.289=-0.017
mean2691.000-2610.000=81.000
σ0.000
min2691.000-2610.000=81.000
max2691.000-2610.000=81.000
mean8.313-8.797=-0.484
σ0.600-0.301=0.298
min7.851-8.469=-0.619
max9.217-9.214=0.003
iters=5
new-facts=6402
prior-facts=6402
mean5001.011-5001.010=0.001
σ0.018-0.026=-0.008
min5000.989-5000.979=0.010
max5001.031-5001.046=-0.015
mean2982.200-2961.400=20.800
σ336.416-266.965=69.451
min2691.000-2622.000=69.000
max3478.000-3317.000=161.000
mean9.601-9.672=-0.071
σ0.404-0.320=0.084
min8.888-9.223=-0.335
max9.830-9.989=-0.159

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.983-1.186=-0.203
σ0.081-0.301=-0.220
min0.914-0.922=-0.008
max1.091-1.563=-0.472

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.441-464.435=0.006
σ574.769-574.781=-0.012
min177.047-177.040=0.007
max1326.594-1326.606=-0.013
mean88.250
σ8.500
min84.000
max101.000
mean2691.000-2610.000=81.000
σ0.000
min2691.000-2610.000=81.000
max2691.000-2610.000=81.000
mean0.535-0.555=-0.021
σ0.542-0.566=-0.024
min0.263-0.271=-0.008
max1.348-1.404=-0.057
policies=20
mean1770.771-1770.742=0.029
σ0.349-0.359=-0.010
min1770.555-1770.508=0.048
max1771.291-1771.276=0.015
mean840.000
σ0.000
min840.000
max840.000
mean2691.000-2610.000=81.000
σ0.000
min2691.000-2610.000=81.000
max2691.000-2610.000=81.000
mean2.725-2.725=-0.001
σ0.010-0.018=-0.009
min2.716-2.709=0.007
max2.737-2.742=-0.005
policies=200
mean17714.931-17714.881=0.050
σ0.495-0.614=-0.119
min17714.600-17714.449=0.151
max17715.667-17715.791=-0.124
mean8400.000
σ0.000
min8400.000
max8400.000
mean2691.000-2610.000=81.000
σ0.000
min2691.000-2610.000=81.000
max2691.000-2610.000=81.000
mean27.539-27.618=-0.078
σ0.086-0.247=-0.161
min27.461-27.340=0.121
max27.629-27.932=-0.303