Compare commits

Home / Compare e9dd88a0 .. cd1b188a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-70.730=-35.468
σ0.053-0.046=0.006
min35.231-70.704=-35.473
max35.409-70.859=-35.450
mean413.000-414.400=-1.400
σ0.000-0.516=-0.516
min413.000-414.000=-1.000
max413.000-415.000=-2.000
mean0.082-0.162=-0.080
σ0.004-0.009=-0.005
min0.076-0.152=-0.076
max0.089-0.176=-0.088
cache=y
dps=1
iters=10
policies=100
mean23.769-21.446=2.323
σ0.003-0.002=0.001
min23.764-21.443=2.321
max23.773-21.450=2.323
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.067-0.065=0.001
σ0.005-0.003=0.002
min0.061-0.063=-0.003
max0.074-0.072=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.486-1754.528=1.959
σ0.367-0.364=0.003
min1755.909-1753.956=1.953
max1757.077-1755.111=1.966
mean1647.300-1654.650=-7.350
σ639.265-632.641=6.624
min626.000-642.000=-16.000
max2824.000-2845.000=-21.000
mean2.314-2.794=-0.480
σ0.103-0.190=-0.087
min2.100-2.275=-0.175
max2.552-3.041=-0.490

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.709-273.610=51.099
σ0.048-0.007=0.041
min324.624-273.601=51.023
max324.739-273.618=51.121
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean0.423-0.387=0.036
σ0.001-0.010=-0.010
min0.423-0.379=0.044
max0.424-0.403=0.021
iters=5
new-facts=1
prior-facts=6402
mean1985.262-1934.001=51.261
σ0.015-0.019=-0.004
min1985.238-1933.973=51.265
max1985.278-1934.023=51.254
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean2.677-3.104=-0.427
σ0.113-0.328=-0.215
min2.550-2.870=-0.320
max2.792-3.679=-0.887
iters=5
new-facts=6402
prior-facts=1
mean4808.861-4614.224=194.637
σ7.669-314.523=-306.854
min4805.404-4051.591=753.813
max4822.580-4756.329=66.251
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean8.799-8.139=0.660
σ0.141-0.723=-0.582
min8.614-7.017=1.598
max8.931-8.790=0.141
iters=5
new-facts=6402
prior-facts=6402
mean4996.466-4945.220=51.246
σ0.021-0.015=0.006
min4996.431-4945.202=51.229
max4996.482-4945.244=51.239
mean3059.000-3025.200=33.800
σ306.841-263.403=43.438
min2824.000-2845.000=-21.000
max3533.000-3445.000=88.000
mean8.561-8.567=-0.007
σ0.296-0.185=0.111
min8.406-8.413=-0.007
max9.089-8.792=0.297

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.094=-0.048
σ0.159-0.182=-0.023
min0.895-0.924=-0.029
max1.305-1.324=-0.019

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.978-472.841=-9.864
σ574.250-574.938=-0.688
min175.842-185.372=-9.530
max1324.353-1335.249=-10.896
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean0.430-0.452=-0.021
σ0.296-0.308=-0.012
min0.278-0.296=-0.018
max0.874-0.913=-0.040
policies=20
mean1758.716-1854.017=-95.301
σ0.349-0.373=-0.024
min1758.478-1853.743=-95.265
max1759.233-1854.560=-95.326
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean2.783-2.955=-0.172
σ0.008-0.027=-0.018
min2.773-2.929=-0.156
max2.792-2.982=-0.190
policies=200
mean17593.349-18546.653=-953.304
σ0.741-0.543=0.198
min17592.336-18546.296=-953.961
max17593.928-18547.459=-953.531
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2824.000-2845.000=-21.000
σ0.000
min2824.000-2845.000=-21.000
max2824.000-2845.000=-21.000
mean27.828-29.192=-1.364
σ0.413-0.469=-0.056
min27.433-28.701=-1.268
max28.294-29.646=-1.352