Compare commits

Home / Compare 9cd14e71 .. 0c36da31

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.973-35.957=0.016
σ0.107-0.101=0.005
min35.922-35.914=0.008
max36.276-36.244=0.032
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.077-0.077=0.001
σ0.004-0.003=0.001
min0.072-0.073=-0.002
max0.085-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.208-26.203=0.006
σ0.003-0.005=-0.003
min26.204-26.195=0.008
max26.212-26.210=0.003
mean411.000-412.000=-1.000
σ0.000
min411.000-412.000=-1.000
max411.000-412.000=-1.000
mean0.060-0.059=0.001
σ0.003-0.003=0.000
min0.057-0.056=0.001
max0.068-0.066=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.379-1756.305=2.074
σ0.371-0.368=0.004
min1757.803-1755.730=2.073
max1758.979-1756.896=2.083
mean1630.700-1635.650=-4.950
σ621.710-632.207=-10.497
min637.000-618.000=19.000
max2815.000-2695.000=120.000
mean2.377-2.402=-0.025
σ0.115-0.105=0.010
min2.283-2.286=-0.003
max2.782-2.686=0.096

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.542-278.822=0.720
σ0.010-0.003=0.007
min279.532-278.819=0.713
max279.555-278.827=0.728
mean2815.000-2695.000=120.000
σ0.000
min2815.000-2695.000=120.000
max2815.000-2695.000=120.000
mean0.414-0.408=0.006
σ0.008-0.001=0.007
min0.408-0.407=0.001
max0.425-0.410=0.015
iters=5
new-facts=1
prior-facts=6402
mean2178.455-2268.876=-90.421
σ0.032-0.013=0.019
min2178.416-2268.864=-90.448
max2178.493-2268.896=-90.403
mean2815.000-2695.000=120.000
σ0.000
min2815.000-2695.000=120.000
max2815.000-2695.000=120.000
mean3.341-3.175=0.166
σ0.069-0.136=-0.067
min3.258-3.036=0.222
max3.426-3.393=0.033
iters=5
new-facts=6402
prior-facts=1
mean5056.404-4787.958=268.445
σ0.993-372.128=-371.135
min5055.795-4122.277=933.518
max5058.170-4955.891=102.278
mean2815.000-2695.000=120.000
σ0.000
min2815.000-2695.000=120.000
max2815.000-2695.000=120.000
mean8.918-7.753=1.165
σ0.615-0.545=0.070
min8.233-6.880=1.353
max9.684-8.358=1.325
iters=5
new-facts=6402
prior-facts=6402
mean5193.549-5168.823=24.726
σ0.364-0.090=0.274
min5192.944-5168.718=24.226
max5193.881-5168.891=24.990
mean3296.400-3259.600=36.800
σ440.858-403.560=37.298
min2815.000-2853.000=-38.000
max3921.000-3660.000=261.000
mean8.898-9.164=-0.266
σ0.055-0.351=-0.296
min8.849-8.551=0.298
max8.982-9.378=-0.396

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.999-0.973=0.027
σ0.068-0.060=0.008
min0.944-0.935=0.009
max1.079-1.077=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.557-459.817=5.740
σ572.658-571.585=1.073
min179.221-174.017=5.204
max1324.544-1317.194=7.350
mean79.500
σ7.000
min76.000
max90.000
mean2815.000-2695.000=120.000
σ0.000
min2815.000-2695.000=120.000
max2815.000-2695.000=120.000
mean0.449-0.535=-0.086
σ0.307-0.528=-0.221
min0.294-0.269=0.025
max0.910-1.327=-0.417
policies=20
mean1792.468-1740.438=52.031
σ0.343-0.315=0.028
min1792.233-1740.255=51.978
max1792.971-1740.909=52.062
mean760.000
σ0.000
min760.000
max760.000
mean2815.000-2695.000=120.000
σ0.000
min2815.000-2695.000=120.000
max2815.000-2695.000=120.000
mean2.910-2.693=0.217
σ0.005-0.025=-0.020
min2.903-2.671=0.231
max2.913-2.724=0.189
policies=200
mean17929.927-17411.199=518.727
σ0.727-0.404=0.323
min17929.297-17410.969=518.327
max17930.751-17411.802=518.949
mean7600.000
σ0.000
min7600.000
max7600.000
mean2815.000-2695.000=120.000
σ0.000
min2815.000-2695.000=120.000
max2815.000-2695.000=120.000
mean28.713-27.032=1.681
σ0.471-0.074=0.397
min28.268-26.924=1.343
max29.371-27.089=2.282