Compare commits

Home / Compare cb41b8b9 .. 3b703fc2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-30.769=0.271
σ0.050-0.046=0.004
min31.003-30.735=0.268
max31.181-30.899=0.282
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.077-0.077=-0.000
σ0.005-0.003=0.002
min0.071-0.073=-0.002
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.060=0.082
σ0.003-0.002=0.001
min21.139-21.057=0.082
max21.148-21.065=0.083
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.064=0.001
σ0.002-0.003=-0.000
min0.063-0.061=0.002
max0.071-0.071=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.421=-0.010
σ0.362-0.360=0.002
min1750.839-1750.854=-0.015
max1751.992-1752.000=-0.008
mean1652.950-1660.000=-7.050
σ646.928-621.609=25.318
min649.000-660.000=-11.000
max2853.000-2503.000=350.000
mean2.835-2.834=0.001
σ0.173-0.144=0.029
min2.284-2.443=-0.159
max3.228-3.088=0.140

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.405-275.757=-2.352
σ0.008-0.008=-0.000
min273.392-275.746=-2.354
max273.413-275.766=-2.353
mean2853.000-2503.000=350.000
σ0.000
min2853.000-2503.000=350.000
max2853.000-2503.000=350.000
mean0.400-0.406=-0.006
σ0.013-0.020=-0.007
min0.383-0.387=-0.004
max0.416-0.428=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1933.839-2168.285=-234.446
σ0.013-0.003=0.010
min1933.825-2168.282=-234.457
max1933.852-2168.289=-234.437
mean2853.000-2503.000=350.000
σ0.000
min2853.000-2503.000=350.000
max2853.000-2503.000=350.000
mean2.871-2.967=-0.096
σ0.213-0.137=0.076
min2.620-2.791=-0.171
max3.092-3.120=-0.028
iters=5
new-facts=6402
prior-facts=1
mean4754.168-5047.983=-293.816
σ1.009-1.055=-0.046
min4753.378-5047.067=-293.689
max4755.914-5049.808=-293.893
mean2853.000-2503.000=350.000
σ0.000
min2853.000-2503.000=350.000
max2853.000-2503.000=350.000
mean8.142-8.854=-0.712
σ0.560-0.490=0.069
min7.704-8.085=-0.380
max9.009-9.343=-0.334
iters=5
new-facts=6402
prior-facts=6402
mean4944.791-5179.240=-234.449
σ0.079-0.069=0.010
min4944.711-5179.175=-234.464
max4944.882-5179.315=-234.433
mean3067.000-3232.000=-165.000
σ289.804-392.249=-102.445
min2853.000-2706.000=147.000
max3519.000-3750.000=-231.000
mean8.436-10.201=-1.765
σ0.124-0.546=-0.422
min8.297-9.591=-1.294
max8.618-10.978=-2.360

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.059-1.560=-0.501
σ0.129-0.128=0.002
min0.941-1.424=-0.483
max1.260-1.714=-0.454

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.339-463.566=-0.227
σ572.194-572.655=-0.461
min177.241-177.233=0.008
max1321.630-1322.549=-0.919
mean79.750
σ7.500
min76.000
max91.000
mean2853.000-2503.000=350.000
σ0.000
min2853.000-2503.000=350.000
max2853.000-2503.000=350.000
mean0.439-0.549=-0.111
σ0.307-0.540=-0.233
min0.283-0.277=0.006
max0.899-1.358=-0.459
policies=20
mean1772.629-1772.605=0.025
σ0.335-0.342=-0.007
min1772.382-1772.365=0.017
max1773.118-1773.110=0.008
mean760.000
σ0.000
min760.000
max760.000
mean2853.000-2503.000=350.000
σ0.000
min2853.000-2503.000=350.000
max2853.000-2503.000=350.000
mean2.853-2.748=0.105
σ0.007-0.012=-0.005
min2.848-2.737=0.111
max2.863-2.764=0.098
policies=200
mean17732.536-17732.959=-0.422
σ0.389-0.561=-0.172
min17732.316-17732.584=-0.268
max17733.119-17733.775=-0.655
mean7600.000
σ0.000
min7600.000
max7600.000
mean2853.000-2503.000=350.000
σ0.000
min2853.000-2503.000=350.000
max2853.000-2503.000=350.000
mean28.363-27.738=0.625
σ0.463-0.069=0.393
min27.832-27.684=0.147
max28.803-27.840=0.963