Compare commits

Home / Compare 2ded326f .. ee5483eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.245-35.225=0.020
σ0.054-0.053=0.001
min35.219-35.197=0.021
max35.397-35.376=0.021
mean411.000-414.700=-3.700
σ0.000-0.483=-0.483
min411.000-414.000=-3.000
max411.000-415.000=-4.000
mean0.085-0.085=0.001
σ0.004-0.004=0.000
min0.082-0.082=-0.000
max0.092-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.755=0.015
σ0.002-0.003=-0.000
min23.767-23.750=0.017
max23.775-23.758=0.017
mean411.000-415.000=-4.000
σ0.000
min411.000-415.000=-4.000
max411.000-415.000=-4.000
mean0.068-0.068=0.000
σ0.003-0.003=0.000
min0.066-0.066=0.000
max0.074-0.074=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.485-1756.357=0.127
σ0.365-0.365=0.000
min1755.910-1755.786=0.124
max1757.066-1756.945=0.120
mean1645.250-1644.700=0.550
σ639.767-632.608=7.159
min622.000-627.000=-5.000
max2820.000-2840.000=-20.000
mean2.322-2.345=-0.023
σ0.070-0.090=-0.021
min2.160-2.139=0.021
max2.421-2.530=-0.109

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.717-324.578=0.139
σ0.016-0.040=-0.024
min324.688-324.507=0.181
max324.726-324.604=0.122
mean2820.000-2840.000=-20.000
σ0.000
min2820.000-2840.000=-20.000
max2820.000-2840.000=-20.000
mean0.424-0.427=-0.003
σ0.002-0.008=-0.006
min0.423-0.421=0.002
max0.427-0.441=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1985.131=0.130
σ0.009-0.014=-0.005
min1985.250-1985.112=0.138
max1985.272-1985.147=0.125
mean2820.000-2840.000=-20.000
σ0.000
min2820.000-2840.000=-20.000
max2820.000-2840.000=-20.000
mean2.606-2.587=0.019
σ0.067-0.099=-0.032
min2.555-2.486=0.070
max2.716-2.750=-0.033
iters=5
new-facts=6402
prior-facts=1
mean4808.750-4808.761=-0.011
σ7.772-7.713=0.059
min4804.820-4805.251=-0.431
max4822.645-4822.559=0.086
mean2820.000-2840.000=-20.000
σ0.000
min2820.000-2840.000=-20.000
max2820.000-2840.000=-20.000
mean8.795-9.087=-0.292
σ0.612-0.296=0.317
min7.711-8.670=-0.959
max9.158-9.428=-0.270
iters=5
new-facts=6402
prior-facts=6402
mean4996.458-4996.189=0.269
σ0.018-0.321=-0.303
min4996.438-4995.615=0.823
max4996.478-4996.353=0.125
mean3065.000-3019.600=45.400
σ314.426-254.909=59.517
min2820.000-2840.000=-20.000
max3544.000-3418.000=126.000
mean8.551-8.471=0.080
σ0.120-0.023=0.097
min8.386-8.453=-0.068
max8.703-8.505=0.198

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-0.972=0.098
σ0.230-0.067=0.162
min0.922-0.914=0.007
max1.471-1.050=0.421

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.977-462.965=0.011
σ574.252-574.254=-0.001
min175.842-175.827=0.015
max1324.355-1324.346=0.009
mean86.250
σ8.500
min82.000
max99.000
mean2820.000-2840.000=-20.000
σ0.000
min2820.000-2840.000=-20.000
max2820.000-2840.000=-20.000
mean0.433-0.433=-0.000
σ0.295-0.298=-0.003
min0.285-0.281=0.004
max0.875-0.879=-0.004
policies=20
mean1758.723-1758.613=0.110
σ0.345-0.345=0.000
min1758.503-1758.379=0.123
max1759.236-1759.123=0.113
mean820.000
σ0.000
min820.000
max820.000
mean2820.000-2840.000=-20.000
σ0.000
min2820.000-2840.000=-20.000
max2820.000-2840.000=-20.000
mean2.808-2.797=0.011
σ0.006-0.005=0.002
min2.802-2.792=0.010
max2.814-2.804=0.011
policies=200
mean17593.085-17592.187=0.899
σ0.793-0.770=0.023
min17592.053-17591.104=0.949
max17593.830-17592.848=0.982
mean8200.000
σ0.000
min8200.000
max8200.000
mean2820.000-2840.000=-20.000
σ0.000
min2820.000-2840.000=-20.000
max2820.000-2840.000=-20.000
mean27.968-28.016=-0.048
σ0.375-0.391=-0.016
min27.639-27.665=-0.026
max28.343-28.445=-0.102