Compare commits

Home / Compare 5a856a67 .. d0f3cba9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtimetime (s)
cache=disabled
datapoints=1
iterations=10
mean167.909-167.913=-0.004
σ0.390-0.393=-0.003
min167.754-167.757=-0.003
max169.006-169.018=-0.012
mean3689.000-3682.000=7.000
σ0.000
min3689.000-3682.000=7.000
max3689.000-3682.000=7.000
mean0.060
σ0.002
min0.057
max0.062
mean0.061
σ0.000
min0.061
max0.062
cache=enabled
datapoints=1
iterations=10
mean167.803-167.802=0.002
σ0.028-0.028=-0.001
min167.768-167.759=0.009
max167.848-167.831=0.018
mean3689.000-3682.000=7.000
σ0.000
min3689.000-3682.000=7.000
max3689.000-3682.000=7.000
mean0.062
σ0.000
min0.061
max0.062
mean0.061
σ0.000
min0.061
max0.062

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtimetime (s)
datapoints=1
iterations=20
mean1753.900-1753.900=0.000
σ0.372-0.369=0.002
min1753.329-1753.326=0.003
max1754.494-1754.491=0.003
mean1651.950-1655.400=-3.450
σ636.972-635.499=1.473
min616.000-617.000=-1.000
max2604.000-2605.000=-1.000
mean2.684
σ0.226
min2.120
max3.061
mean2.751
σ0.173
min2.164
max2.944

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtimetime (s)
iters=5
new-facts=1
prior-facts=1
mean190.717-190.718=-0.001
σ0.003-0.009=-0.006
min190.713-190.709=0.004
max190.722-190.732=-0.010
mean2604.000-2605.000=-1.000
σ0.000
min2604.000-2605.000=-1.000
max2604.000-2605.000=-1.000
mean0.281
σ0.002
min0.279
max0.285
mean0.280
σ0.001
min0.280
max0.281
iters=5
new-facts=1
prior-facts=6402
mean1989.483-1989.490=-0.007
σ0.024-0.015=0.010
min1989.445-1989.472=-0.027
max1989.506-1989.511=-0.005
mean2604.000-2605.000=-1.000
σ0.000
min2604.000-2605.000=-1.000
max2604.000-2605.000=-1.000
mean2.543
σ0.194
min2.319
max2.809
mean2.515
σ0.242
min2.225
max2.774
iters=5
new-facts=6402
prior-facts=1
mean4880.173-4880.058=0.115
σ0.619-0.677=-0.059
min4879.890-4879.305=0.586
max4881.280-4881.158=0.122
mean2604.000-2605.000=-1.000
σ0.000
min2604.000-2605.000=-1.000
max2604.000-2605.000=-1.000
mean8.226
σ0.321
min7.724
max8.545
mean8.120
σ0.163
min7.879
max8.326
iters=5
new-facts=6402
prior-facts=6402
mean4891.787-4891.782=0.005
σ0.020-0.014=0.006
min4891.767-4891.762=0.005
max4891.815-4891.796=0.018
mean3279.600-3269.400=10.200
σ405.594-407.660=-2.066
min2878.000-2867.000=11.000
max3689.000-3682.000=7.000
mean8.032
σ0.100
min7.938
max8.169
mean8.202
σ0.286
min7.951
max8.620

newProductH/cdr_auton/broker

Factortime (s)time_s
iterations=5
mean1.566
σ0.221
min1.204
max1.745
mean1.514
σ0.305
min1.247
max1.861

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtimetime (s)
policies=2
mean456.477-456.477=-0.001
σ572.535-572.535=0.000
min170.204-170.208=-0.004
max1315.279-1315.280=-0.001
mean79.500
σ7.000
min76.000
max90.000
mean431.000
σ1.155
min430.000
max432.000
mean0.549
σ0.557
min0.269
max1.385
mean0.574
σ0.597
min0.270
max1.468
policies=20
mean1702.603-1702.596=0.007
σ0.322-0.307=0.016
min1702.361-1702.372=-0.011
max1703.074-1703.045=0.029
mean760.000
σ0.000
min760.000
max760.000
mean445.250
σ11.615
min432.000
max455.000
mean2.624
σ0.013
min2.611
max2.641
mean2.641
σ0.015
min2.627
max2.660
policies=200
mean17035.434-17035.328=0.107
σ0.074-0.069=0.005
min17035.366-17035.234=0.132
max17035.531-17035.381=0.150
mean7600.000
σ0.000
min7600.000
max7600.000
mean490.000-488.250=1.750
σ1.414-1.500=-0.086
min489.000-487.000=2.000
max492.000-490.000=2.000
mean26.449
σ0.129
min26.352
max26.637
mean26.457
σ0.209
min26.311
max26.764