Compare commits

Home / Compare b790c6bb .. b381bc0b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtimetime_s
cache=disabled
datapoints=1
iterations=10
mean1223.321-1223.200=0.121
σ2.668-2.286=0.382
min1222.320-1222.335=-0.016
max1230.829-1229.614=1.215
mean3795.000-4082.000=-287.000
σ0.000
min3795.000-4082.000=-287.000
max3795.000-4082.000=-287.000
mean0.357
σ0.003
min0.352
max0.362
mean0.351
σ0.010
min0.335
max0.361
cache=enabled
datapoints=1
iterations=10
mean82.804-82.805=-0.000
σ0.003-0.003=0.000
min82.799-82.801=-0.001
max82.810-82.809=0.000
mean3795.000-4082.000=-287.000
σ0.000
min3795.000-4082.000=-287.000
max3795.000-4082.000=-287.000
mean0.041
σ0.004
min0.039
max0.053
mean0.041
σ0.004
min0.039
max0.054

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtimetime_s
datapoints=1
iterations=20
mean1753.901-1753.898=0.003
σ0.370-0.372=-0.002
min1753.324-1753.323=0.001
max1754.498-1754.495=0.003
mean1671.850-1650.650=21.200
σ638.149-622.364=15.785
min622.000-616.000=6.000
max2687.000-2640.000=47.000
mean2.706
σ0.194
min2.190
max2.992
mean2.712
σ0.166
min2.290
max3.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtimetime_s
iters=5
new-facts=1
prior-facts=1
mean190.717-190.715=0.002
σ0.005-0.011=-0.005
min190.713-190.703=0.009
max190.723-190.731=-0.008
mean2687.000-2640.000=47.000
σ0.000
min2687.000-2640.000=47.000
max2687.000-2640.000=47.000
mean0.279
σ0.002
min0.277
max0.282
mean0.280
σ0.000
min0.279
max0.281
iters=5
new-facts=1
prior-facts=6402
mean1989.503-1989.495=0.008
σ0.013-0.012=0.002
min1989.492-1989.480=0.012
max1989.524-1989.507=0.017
mean2687.000-2640.000=47.000
σ0.000
min2687.000-2640.000=47.000
max2687.000-2640.000=47.000
mean2.612
σ0.187
min2.397
max2.804
mean2.430
σ0.111
min2.322
max2.617
iters=5
new-facts=6402
prior-facts=1
mean4880.161-4880.171=-0.010
σ0.603-0.597=0.006
min4879.864-4879.887=-0.023
max4881.240-4881.239=0.002
mean2687.000-2640.000=47.000
σ0.000
min2687.000-2640.000=47.000
max2687.000-2640.000=47.000
mean8.281
σ0.152
min8.102
max8.447
mean8.176
σ0.274
min7.786
max8.483
iters=5
new-facts=6402
prior-facts=6402
mean4891.770-4891.790=-0.020
σ0.018-0.012=0.007
min4891.758-4891.776=-0.019
max4891.802-4891.802=-0.001
mean3320.600-3378.600=-58.000
σ493.896-498.576=-4.680
min2687.000-2770.000=-83.000
max3795.000-4082.000=-287.000
mean8.129
σ0.120
min8.003
max8.299
mean8.167
σ0.113
min8.042
max8.301

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.097-1.070=0.027
σ0.204-0.138=0.066
min0.950-0.950=-0.000
max1.374-1.288=0.086

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtimetime_s
policies=2
mean456.477-456.477=-0.000
σ572.534-572.534=-0.000
min170.210-170.208=0.002
max1315.279-1315.279=-0.000
mean79.500
σ7.000
min76.000
max90.000
mean432.000
σ0.000
min432.000
max432.000
mean0.563
σ0.598
min0.259
max1.461
mean0.552
σ0.567
min0.262
max1.402
policies=20
mean1702.596-1702.573=0.023
σ0.307-0.309=-0.002
min1702.372-1702.357=0.015
max1703.046-1703.028=0.018
mean760.000
σ0.000
min760.000
max760.000
mean445.000-447.000=-2.000
σ11.662-12.463=-0.801
min433.000-434.000=-1.000
max461.000-464.000=-3.000
mean2.641
σ0.003
min2.638
max2.643
mean2.635
σ0.014
min2.617
max2.649
policies=200
mean17035.322-17035.260=0.062
σ0.073-0.035=0.038
min17035.262-17035.216=0.046
max17035.423-17035.301=0.122
mean7600.000
σ0.000
min7600.000
max7600.000
mean494.000-489.000=5.000
σ3.162-1.414=1.748
min490.000-488.000=2.000
max497.000-491.000=6.000
mean26.526
σ0.054
min26.452
max26.569
mean26.539
σ0.159
min26.363
max26.729