Compare commits

Home / Compare 3d7ace94 .. 63b092a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.709-36.702=0.006
σ0.848-0.620=0.229
min35.914-35.907=0.007
max38.423-37.399=1.024
mean423.200-425.100=-1.900
σ0.422-0.316=0.105
min423.000-425.000=-2.000
max424.000-426.000=-2.000
mean0.077-0.076=0.000
σ0.004-0.004=0.001
min0.072-0.074=-0.002
max0.085-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.700-26.699=0.001
σ0.649-0.647=0.002
min26.195-26.195=0.000
max27.462-27.454=0.008
mean424.000-426.000=-2.000
σ0.000
min424.000-426.000=-2.000
max424.000-426.000=-2.000
mean0.058-0.061=-0.003
σ0.003-0.002=0.001
min0.056-0.059=-0.003
max0.066-0.066=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.298-1756.288=0.009
σ0.369-0.368=0.001
min1755.722-1755.715=0.007
max1756.889-1756.882=0.007
mean1669.850-1667.150=2.700
σ620.709-629.783=-9.074
min695.000-621.000=74.000
max2646.000-2732.000=-86.000
mean2.344-2.353=-0.009
σ0.091-0.118=-0.027
min2.116-2.254=-0.138
max2.555-2.793=-0.239

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.814-278.792=0.021
σ0.009-0.007=0.003
min278.803-278.785=0.018
max278.828-278.802=0.025
mean2646.000-2732.000=-86.000
σ0.000
min2646.000-2732.000=-86.000
max2646.000-2732.000=-86.000
mean0.409-0.411=-0.002
σ0.005-0.006=-0.001
min0.405-0.406=-0.001
max0.416-0.419=-0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.869-2268.856=0.013
σ0.010-0.009=0.001
min2268.853-2268.849=0.004
max2268.880-2268.871=0.009
mean2646.000-2732.000=-86.000
σ0.000
min2646.000-2732.000=-86.000
max2646.000-2732.000=-86.000
mean2.995-3.061=-0.066
σ0.090-0.216=-0.126
min2.906-2.853=0.052
max3.099-3.339=-0.240
iters=5
new-facts=6402
prior-facts=1
mean4954.262-4954.015=0.247
σ0.804-1.125=-0.321
min4953.853-4952.796=1.058
max4955.700-4955.859=-0.159
mean2646.000-2732.000=-86.000
σ0.000
min2646.000-2732.000=-86.000
max2646.000-2732.000=-86.000
mean7.930-8.009=-0.079
σ0.258-0.383=-0.125
min7.678-7.678=-0.000
max8.321-8.666=-0.346
iters=5
new-facts=6402
prior-facts=6402
mean5168.819-5168.801=0.018
σ0.085-0.095=-0.010
min5168.722-5168.697=0.025
max5168.901-5168.913=-0.012
mean3508.200-3480.200=28.000
σ487.546-507.847=-20.302
min2873.000-2851.000=22.000
max4187.000-4181.000=6.000
mean9.338-9.521=-0.183
σ0.304-0.578=-0.274
min8.871-9.112=-0.241
max9.614-10.540=-0.926

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.262-1.054=0.208
σ0.338-0.125=0.212
min0.940-0.941=-0.001
max1.823-1.251=0.573

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean459.809-459.803=0.005
σ571.593-571.585=0.008
min174.006-174.000=0.006
max1317.198-1317.181=0.017
mean79.500
σ7.000
min76.000
max90.000
mean2646.000-2732.000=-86.000
σ0.000
min2646.000-2732.000=-86.000
max2646.000-2732.000=-86.000
mean0.537-0.538=-0.001
σ0.542-0.542=-0.001
min0.265-0.263=0.002
max1.349-1.351=-0.002
policies=20
mean1740.323-1740.302=0.020
σ0.304-0.309=-0.005
min1740.118-1740.091=0.027
max1740.773-1740.761=0.013
mean760.000
σ0.000
min760.000
max760.000
mean2646.000-2732.000=-86.000
σ0.000
min2646.000-2732.000=-86.000
max2646.000-2732.000=-86.000
mean2.663-2.695=-0.032
σ0.031-0.010=0.021
min2.631-2.680=-0.050
max2.704-2.705=-0.001
policies=200
mean17410.227-17409.674=0.553
σ0.491-0.558=-0.067
min17409.972-17409.335=0.637
max17410.964-17410.509=0.456
mean7600.000
σ0.000
min7600.000
max7600.000
mean2646.000-2732.000=-86.000
σ0.000
min2646.000-2732.000=-86.000
max2646.000-2732.000=-86.000
mean26.867-26.901=-0.034
σ0.042-0.062=-0.020
min26.822-26.826=-0.005
max26.922-26.971=-0.049