Compare commits

Home / Compare 0f6dde54 .. c0cc06e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.381-31.046=39.335
σ0.059-0.049=0.010
min70.347-31.003=39.344
max70.546-31.181=39.365
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.159-0.078=0.081
σ0.006-0.004=0.002
min0.145-0.071=0.074
max0.165-0.086=0.079
cache=y
dps=1
iters=10
policies=100
mean21.147-21.146=0.001
σ0.002-0.002=0.001
min21.143-21.143=0.000
max21.150-21.148=0.002
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.063-0.060=0.004
σ0.003-0.003=-0.000
min0.059-0.058=0.002
max0.071-0.068=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.198-1751.407=0.791
σ0.362-0.360=0.001
min1751.622-1750.840=0.782
max1752.785-1751.973=0.812
mean1643.300-1641.150=2.150
σ621.095-615.184=5.911
min646.000-630.000=16.000
max2484.000-2475.000=9.000
mean2.789-2.752=0.037
σ0.158-0.185=-0.028
min2.278-2.492=-0.214
max3.035-3.031=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.927-266.778=3.149
σ0.009-0.005=0.004
min269.921-266.771=3.150
max269.941-266.782=3.159
mean2484.000-2475.000=9.000
σ0.000
min2484.000-2475.000=9.000
max2484.000-2475.000=9.000
mean0.373-0.365=0.007
σ0.007-0.003=0.003
min0.369-0.361=0.008
max0.384-0.370=0.015
iters=5
new-facts=1
prior-facts=6402
mean1930.383-1927.212=3.171
σ0.020-0.010=0.010
min1930.360-1927.202=3.158
max1930.399-1927.223=3.175
mean2484.000-2475.000=9.000
σ0.000
min2484.000-2475.000=9.000
max2484.000-2475.000=9.000
mean2.556-2.924=-0.368
σ0.159-0.275=-0.117
min2.427-2.460=-0.033
max2.831-3.170=-0.339
iters=5
new-facts=6402
prior-facts=1
mean4750.860-4747.684=3.177
σ0.875-0.953=-0.078
min4750.435-4746.927=3.508
max4752.424-4749.336=3.088
mean2484.000-2475.000=9.000
σ0.000
min2484.000-2475.000=9.000
max2484.000-2475.000=9.000
mean8.694-8.213=0.481
σ0.401-0.441=-0.041
min8.275-7.692=0.583
max9.133-8.907=0.226
iters=5
new-facts=6402
prior-facts=6402
mean4941.295-4938.196=3.099
σ0.152-0.087=0.065
min4941.065-4938.094=2.971
max4941.435-4938.279=3.156
mean2997.200-2969.200=28.000
σ283.625-434.536=-150.911
min2606.000-2475.000=131.000
max3330.000-3556.000=-226.000
mean8.621-8.598=0.024
σ0.362-0.419=-0.057
min8.333-8.299=0.034
max9.215-9.315=-0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.661-1.747=-0.086
σ0.181-0.136=0.045
min1.472-1.512=-0.040
max1.859-1.865=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.900-465.108=0.791
σ575.757-575.755=0.001
min178.020-177.227=0.792
max1329.535-1328.741=0.794
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2484.000-2475.000=9.000
σ0.000
min2484.000-2475.000=9.000
max2484.000-2475.000=9.000
mean0.564-0.564=0.000
σ0.555-0.561=-0.007
min0.280-0.281=-0.002
max1.397-1.406=-0.010
policies=20
mean1780.417-1772.554=7.863
σ0.358-0.333=0.025
min1780.187-1772.334=7.853
max1780.950-1773.048=7.901
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2484.000-2475.000=9.000
σ0.000
min2484.000-2475.000=9.000
max2484.000-2475.000=9.000
mean2.771-2.736=0.035
σ0.009-0.003=0.006
min2.761-2.731=0.030
max2.782-2.739=0.043
policies=200
mean17811.047-17732.345=78.702
σ0.564-0.463=0.101
min17810.683-17732.050=78.633
max17811.877-17733.037=78.840
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2484.000-2475.000=9.000
σ0.000
min2484.000-2475.000=9.000
max2484.000-2475.000=9.000
mean28.001-27.601=0.400
σ0.063-0.137=-0.074
min27.915-27.522=0.392
max28.066-27.806=0.261