Compare commits

Home / Compare 142dd508 .. d17bacae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.618-35.263=0.355
σ0.053-0.054=-0.001
min35.589-35.230=0.359
max35.767-35.416=0.352
mean415.600-412.000=3.600
σ0.516-0.000=0.516
min415.000-412.000=3.000
max416.000-412.000=4.000
mean0.086-0.084=0.001
σ0.004-0.003=0.001
min0.082-0.082=0.000
max0.093-0.092=0.001
cache=y
dps=1
iters=10
policies=100
mean24.048-23.770=0.278
σ0.002-0.004=-0.002
min24.045-23.764=0.281
max24.051-23.776=0.275
mean416.000-412.000=4.000
σ0.000
min416.000-412.000=4.000
max416.000-412.000=4.000
mean0.068-0.069=-0.000
σ0.003-0.003=-0.000
min0.066-0.066=-0.000
max0.076-0.075=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.491-1756.486=0.005
σ0.364-0.365=-0.001
min1755.916-1755.909=0.007
max1757.081-1757.072=0.009
mean1653.900-1647.900=6.000
σ629.168-642.307=-13.139
min619.000-623.000=-4.000
max2690.000-2840.000=-150.000
mean2.350-2.345=0.004
σ0.104-0.098=0.005
min2.239-2.245=-0.005
max2.652-2.583=0.069

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.766-324.683=0.083
σ0.048-0.041=0.007
min324.681-324.611=0.070
max324.793-324.708=0.085
mean2690.000-2840.000=-150.000
σ0.000
min2690.000-2840.000=-150.000
max2690.000-2840.000=-150.000
mean0.427-0.430=-0.003
σ0.010-0.007=0.003
min0.420-0.423=-0.003
max0.445-0.440=0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.317-1985.261=0.056
σ0.020-0.015=0.005
min1985.284-1985.244=0.040
max1985.332-1985.273=0.060
mean2690.000-2840.000=-150.000
σ0.000
min2690.000-2840.000=-150.000
max2690.000-2840.000=-150.000
mean2.617-2.659=-0.042
σ0.079-0.146=-0.067
min2.558-2.520=0.038
max2.733-2.855=-0.122
iters=5
new-facts=6402
prior-facts=1
mean4808.975-4808.898=0.076
σ7.796-7.688=0.108
min4805.048-4805.396=-0.348
max4822.914-4822.651=0.263
mean2690.000-2840.000=-150.000
σ0.000
min2690.000-2840.000=-150.000
max2690.000-2840.000=-150.000
mean9.029-9.109=-0.080
σ0.132-0.292=-0.160
min8.889-8.673=0.216
max9.234-9.362=-0.128
iters=5
new-facts=6402
prior-facts=6402
mean4996.494-4996.469=0.025
σ0.178-0.009=0.169
min4996.285-4996.458=-0.173
max4996.640-4996.480=0.161
mean3058.800-3041.800=17.000
σ293.251-203.884=89.367
min2690.000-2840.000=-150.000
max3333.000-3319.000=14.000
mean8.914-8.806=0.108
σ0.415-0.247=0.168
min8.568-8.501=0.067
max9.554-9.144=0.410

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.952-0.998=-0.047
σ0.057-0.062=-0.005
min0.917-0.920=-0.003
max1.050-1.048=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-462.978=0.237
σ574.773-574.252=0.520
min175.813-175.838=-0.025
max1325.373-1324.356=1.017
mean86.250
σ8.500
min82.000
max99.000
mean2690.000-2840.000=-150.000
σ0.000
min2690.000-2840.000=-150.000
max2690.000-2840.000=-150.000
mean0.564-0.431=0.133
σ0.578-0.299=0.279
min0.272-0.276=-0.004
max1.431-0.880=0.551
policies=20
mean1758.505-1758.707=-0.202
σ0.333-0.347=-0.014
min1758.295-1758.470=-0.175
max1759.001-1759.220=-0.219
mean820.000
σ0.000
min820.000
max820.000
mean2690.000-2840.000=-150.000
σ0.000
min2690.000-2840.000=-150.000
max2690.000-2840.000=-150.000
mean2.717-2.803=-0.086
σ0.012-0.007=0.005
min2.704-2.797=-0.092
max2.729-2.814=-0.085
policies=200
mean17592.116-17593.288=-1.172
σ0.421-0.676=-0.255
min17591.847-17592.420=-0.573
max17592.744-17593.861=-1.117
mean8200.000
σ0.000
min8200.000
max8200.000
mean2690.000-2840.000=-150.000
σ0.000
min2690.000-2840.000=-150.000
max2690.000-2840.000=-150.000
mean27.450-27.931=-0.481
σ0.029-0.374=-0.345
min27.432-27.475=-0.043
max27.492-28.362=-0.870