Compare commits

Home / Compare d3d4bf8a .. ac627152

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.704-53.648=0.056
σ0.365-0.368=-0.002
min53.566-53.518=0.048
max54.742-54.694=0.049
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.136-0.140=-0.004
σ0.005-0.005=-0.000
min0.127-0.134=-0.007
max0.142-0.148=-0.006
cache=y
dps=1
iters=10
policies=100
mean42.977-42.942=0.036
σ0.005-0.006=-0.001
min42.971-42.931=0.040
max42.988-42.951=0.037
mean415.000-416.800=-1.800
σ0.000-0.422=-0.422
min415.000-416.000=-1.000
max415.000-417.000=-2.000
mean0.118-0.119=-0.001
σ0.004-0.005=-0.000
min0.113-0.114=-0.001
max0.126-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.902-991.857=3.045
σ1.202-1.221=-0.019
min994.363-991.266=3.097
max999.946-996.975=2.970
mean1061.350-1072.400=-11.050
σ323.131-318.050=5.081
min561.000-608.000=-47.000
max1625.000-1636.000=-11.000
mean1.454-1.513=-0.059
σ0.078-0.059=0.019
min1.390-1.459=-0.069
max1.651-1.702=-0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.314-285.439=11.875
σ0.008-0.014=-0.006
min297.307-285.417=11.890
max297.328-285.453=11.875
mean1625.000-1636.000=-11.000
σ0.000
min1625.000-1636.000=-11.000
max1625.000-1636.000=-11.000
mean0.394-0.382=0.012
σ0.007-0.008=-0.002
min0.387-0.376=0.011
max0.402-0.397=0.005
iters=5
new-facts=1
prior-facts=6402
mean1298.661-1285.511=13.150
σ0.025-0.090=-0.065
min1298.625-1285.355=13.270
max1298.690-1285.581=13.109
mean1625.000-1636.000=-11.000
σ0.000
min1625.000-1636.000=-11.000
max1625.000-1636.000=-11.000
mean1.883-2.003=-0.120
σ0.050-0.274=-0.224
min1.833-1.813=0.020
max1.964-2.487=-0.523
iters=5
new-facts=6402
prior-facts=1
mean1718.875-1705.831=13.044
σ6.934-6.860=0.074
min1715.648-1702.647=13.000
max1731.275-1718.100=13.175
mean1625.000-1636.000=-11.000
σ0.000
min1625.000-1636.000=-11.000
max1625.000-1636.000=-11.000
mean2.959-2.962=-0.003
σ0.443-0.175=0.268
min2.533-2.781=-0.248
max3.687-3.236=0.451
iters=5
new-facts=6402
prior-facts=6402
mean1981.621-1968.407=13.214
σ0.016-0.044=-0.027
min1981.602-1968.335=13.267
max1981.640-1968.437=13.202
mean1880.600-1776.600=104.000
σ194.444-145.117=49.327
min1625.000-1636.000=-11.000
max2087.000-1974.000=113.000
mean3.258-3.142=0.116
σ0.093-0.109=-0.016
min3.143-3.074=0.069
max3.345-3.335=0.010

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.198-1.133=0.065
σ0.277-0.227=0.050
min0.916-0.900=0.016
max1.648-1.486=0.163

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.371-436.770=3.601
σ572.883-572.348=0.535
min153.927-150.590=3.337
max1299.696-1295.292=4.403
mean94.250-90.250=4.000
σ8.500
min90.000-86.000=4.000
max107.000-103.000=4.000
mean1625.000-1636.000=-11.000
σ0.000
min1625.000-1636.000=-11.000
max1625.000-1636.000=-11.000
mean0.542-0.525=0.017
σ0.573-0.545=0.028
min0.254-0.251=0.004
max1.401-1.342=0.059
policies=20
mean1539.512-1506.198=33.314
σ0.298-0.247=0.051
min1539.325-1506.041=33.283
max1539.956-1506.567=33.389
mean900.000-860.000=40.000
σ0.000
min900.000-860.000=40.000
max900.000-860.000=40.000
mean1625.000-1636.000=-11.000
σ0.000
min1625.000-1636.000=-11.000
max1625.000-1636.000=-11.000
mean2.558-2.539=0.018
σ0.010-0.035=-0.025
min2.548-2.514=0.033
max2.569-2.591=-0.023
policies=200
mean15403.078-15069.449=333.629
σ0.057-0.139=-0.082
min15403.026-15069.336=333.690
max15403.159-15069.629=333.529
mean9000.000-8600.000=400.000
σ0.000
min9000.000-8600.000=400.000
max9000.000-8600.000=400.000
mean1625.000-1636.000=-11.000
σ0.000
min1625.000-1636.000=-11.000
max1625.000-1636.000=-11.000
mean25.983-25.568=0.415
σ0.211-0.070=0.141
min25.817-25.494=0.323
max26.259-25.630=0.630