Compare commits

Home / Compare 2f367be1 .. a176676a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.617=0.001
σ0.054-0.055=-0.001
min35.589-35.589=0.000
max35.771-35.772=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.085-0.083=0.002
σ0.004-0.005=-0.001
min0.082-0.077=0.005
max0.093-0.089=0.003
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=0.000
σ0.004-0.004=0.000
min24.042-24.042=-0.000
max24.053-24.055=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.066-0.067=-0.001
σ0.004-0.005=-0.000
min0.061-0.062=-0.001
max0.074-0.075=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.489=0.001
σ0.365-0.364=0.001
min1755.917-1755.917=0.000
max1757.083-1757.077=0.006
mean1646.750-1647.150=-0.400
σ641.579-644.773=-3.195
min631.000-623.000=8.000
max2839.000-2724.000=115.000
mean2.356-2.385=-0.029
σ0.076-0.135=-0.060
min2.275-2.219=0.056
max2.550-2.682=-0.132

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.767-324.763=0.005
σ0.047-0.053=-0.006
min324.685-324.668=0.016
max324.800-324.791=0.008
mean2839.000-2724.000=115.000
σ0.000
min2839.000-2724.000=115.000
max2839.000-2724.000=115.000
mean0.428-0.429=-0.001
σ0.008-0.008=-0.000
min0.423-0.422=0.001
max0.442-0.443=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1985.327-1985.320=0.007
σ0.005-0.014=-0.008
min1985.318-1985.298=0.020
max1985.331-1985.336=-0.004
mean2839.000-2724.000=115.000
σ0.000
min2839.000-2724.000=115.000
max2839.000-2724.000=115.000
mean2.623-2.607=0.015
σ0.086-0.062=0.024
min2.529-2.555=-0.026
max2.731-2.712=0.019
iters=5
new-facts=6402
prior-facts=1
mean4809.018-4809.081=-0.063
σ7.774-7.710=0.064
min4804.984-4805.552=-0.568
max4822.911-4822.872=0.039
mean2839.000-2724.000=115.000
σ0.000
min2839.000-2724.000=115.000
max2839.000-2724.000=115.000
mean9.015-8.954=0.062
σ0.426-0.118=0.308
min8.339-8.800=-0.461
max9.479-9.073=0.406
iters=5
new-facts=6402
prior-facts=6402
mean4996.623-4996.622=0.001
σ0.025-0.021=0.004
min4996.600-4996.600=0.000
max4996.664-4996.648=0.015
mean3063.400-3024.800=38.600
σ306.063-353.014=-46.951
min2839.000-2724.000=115.000
max3539.000-3546.000=-7.000
mean8.558-8.509=0.049
σ0.092-0.127=-0.035
min8.465-8.417=0.048
max8.710-8.731=-0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.973-0.949=0.025
σ0.068-0.058=0.010
min0.912-0.913=-0.001
max1.061-1.050=0.011

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.217-463.210=0.007
σ574.772-574.778=-0.007
min175.821-175.812=0.009
max1325.374-1325.377=-0.003
mean86.250
σ8.500
min82.000
max99.000
mean2839.000-2724.000=115.000
σ0.000
min2839.000-2724.000=115.000
max2839.000-2724.000=115.000
mean0.428-0.541=-0.113
σ0.290-0.535=-0.245
min0.281-0.271=0.010
max0.863-1.343=-0.480
policies=20
mean1758.535-1758.482=0.053
σ0.352-0.335=0.017
min1758.296-1758.275=0.022
max1759.056-1758.982=0.074
mean820.000
σ0.000
min820.000
max820.000
mean2839.000-2724.000=115.000
σ0.000
min2839.000-2724.000=115.000
max2839.000-2724.000=115.000
mean2.812-2.718=0.093
σ0.021-0.008=0.013
min2.796-2.709=0.087
max2.843-2.725=0.118
policies=200
mean17592.114-17592.102=0.012
σ0.411-0.489=-0.078
min17591.676-17591.839=-0.163
max17592.669-17592.835=-0.166
mean8200.000
σ0.000
min8200.000
max8200.000
mean2839.000-2724.000=115.000
σ0.000
min2839.000-2724.000=115.000
max2839.000-2724.000=115.000
mean27.892-27.461=0.431
σ0.396-0.110=0.286
min27.524-27.315=0.209
max28.327-27.546=0.781