Compare commits

Home / Compare b82c3fb7 .. 4fc45a8a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.728
σ0.614
min35.921
max37.221
mean4009.000
σ0.000
min4009.000
max4009.000
mean0.075
σ0.001
min0.073
max0.076
cache=y
dps=1
iters=10
policies=100
mean26.713
σ0.646
min26.208
max27.465
mean4009.000
σ0.000
min4009.000
max4009.000
mean0.060
σ0.001
min0.059
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.378-1754.047=2.331
σ0.376-0.368=0.008
min1755.805-1753.468=2.337
max1756.995-1754.637=2.358
mean1670.300-1662.000=8.300
σ624.871-641.590=-16.720
min661.000-619.000=42.000
max2603.000-2619.000=-16.000
mean2.339-2.746=-0.407
σ0.198-0.198=-0.000
min2.172-2.241=-0.068
max2.822-3.055=-0.233

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.717-190.715=88.002
σ0.006-0.007=-0.000
min278.710-190.706=88.004
max278.724-190.721=88.002
mean2603.000-2619.000=-16.000
σ0.000
min2603.000-2619.000=-16.000
max2603.000-2619.000=-16.000
mean0.419-0.281=0.138
σ0.001-0.001=0.000
min0.418-0.280=0.137
max0.420-0.282=0.138
iters=5
new-facts=1
prior-facts=6402
mean2268.888-1989.502=279.386
σ0.007-0.008=-0.001
min2268.877-1989.490=279.386
max2268.894-1989.513=279.381
mean2603.000-2619.000=-16.000
σ0.000
min2603.000-2619.000=-16.000
max2603.000-2619.000=-16.000
mean2.995-2.588=0.407
σ0.184-0.142=0.042
min2.805-2.375=0.430
max3.301-2.740=0.561
iters=5
new-facts=6402
prior-facts=1
mean4952.254-4880.082=72.173
σ0.986-0.602=0.384
min4951.286-4879.736=71.550
max4953.923-4881.150=72.773
mean2603.000-2619.000=-16.000
σ0.000
min2603.000-2619.000=-16.000
max2603.000-2619.000=-16.000
mean8.075-8.202=-0.127
σ0.285-0.149=0.136
min7.831-8.044=-0.213
max8.540-8.441=0.099
iters=5
new-facts=6402
prior-facts=6402
mean5167.095-4891.546=275.549
σ0.009-0.272=-0.263
min5167.082-4891.254=275.828
max5167.105-4891.795=275.310
mean3353.400-3306.600=46.800
σ449.576-513.372=-63.796
min2831.000-2619.000=212.000
max4009.000-3784.000=225.000
mean9.339-8.211=1.128
σ0.364-0.175=0.189
min9.026-8.033=0.993
max9.904-8.467=1.438

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.202=-0.144
σ0.125-0.294=-0.169
min0.938-0.943=-0.004
max1.250-1.694=-0.445

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.263-456.475=3.789
σ572.607-572.536=0.071
min173.959-170.202=3.757
max1319.173-1315.278=3.895
mean79.500
σ7.000
min76.000
max90.000
mean436.000-431.000=5.000
σ0.000-1.155=-1.155
min436.000-430.000=6.000
max436.000-432.000=4.000
mean0.553-0.543=0.011
σ0.556-0.528=0.029
min0.270-0.272=-0.002
max1.388-1.335=0.053
policies=20
mean1740.095-1702.595=37.501
σ0.325-0.324=0.001
min1739.855-1702.357=37.498
max1740.571-1703.068=37.503
mean760.000
σ0.000
min760.000
max760.000
mean444.750-444.000=0.750
σ8.461-10.677=-2.216
min436.000-432.000=4.000
max452.000-453.000=-1.000
mean2.670-2.642=0.027
σ0.023-0.012=0.011
min2.637-2.632=0.006
max2.689-2.657=0.032
policies=200
mean17410.237-17035.437=374.800
σ0.073-0.058=0.015
min17410.129-17035.372=374.757
max17410.289-17035.512=374.777
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.750
σ2.217-2.986=-0.769
min488.000-487.000=1.000
max493.000-494.000=-1.000
mean26.983-26.509=0.474
σ0.069-0.076=-0.007
min26.908-26.463=0.445
max27.055-26.623=0.431