Compare commits

Home / Compare 159a5b7f .. a614673e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.769-30.769=-0.001
σ0.048-0.047=0.000
min30.728-30.726=0.002
max30.901-30.899=0.002
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.076-0.074=0.002
σ0.005-0.004=0.001
min0.071-0.070=0.001
max0.086-0.080=0.006
cache=y
dps=1
iters=10
policies=100
mean21.060-21.061=-0.001
σ0.003-0.002=0.001
min21.055-21.057=-0.002
max21.064-21.064=0.000
mean412.000-414.000=-2.000
σ0.000
min412.000-414.000=-2.000
max412.000-414.000=-2.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.000
min0.057-0.057=0.000
max0.066-0.068=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.420-1751.420=-0.000
σ0.361-0.360=0.001
min1750.858-1750.851=0.006
max1752.007-1752.005=0.002
mean1658.550-1650.450=8.100
σ634.313-624.593=9.719
min617.000-680.000=-63.000
max2772.000-2652.000=120.000
mean2.813-2.837=-0.024
σ0.198-0.127=0.071
min2.323-2.528=-0.205
max3.149-3.081=0.068

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.760-275.730=0.030
σ0.010-0.009=0.001
min275.747-275.721=0.026
max275.773-275.744=0.029
mean2772.000-2652.000=120.000
σ0.000
min2772.000-2652.000=120.000
max2772.000-2652.000=120.000
mean0.408-0.402=0.006
σ0.008-0.008=0.001
min0.399-0.397=0.002
max0.417-0.415=0.002
iters=5
new-facts=1
prior-facts=6402
mean2168.290-2168.274=0.016
σ0.007-0.021=-0.015
min2168.285-2168.254=0.031
max2168.299-2168.300=-0.000
mean2772.000-2652.000=120.000
σ0.000
min2772.000-2652.000=120.000
max2772.000-2652.000=120.000
mean3.014-2.970=0.043
σ0.134-0.134=-0.001
min2.834-2.757=0.077
max3.161-3.090=0.070
iters=5
new-facts=6402
prior-facts=1
mean5048.100-5048.100=-0.000
σ0.926-0.917=0.009
min5047.616-5047.515=0.101
max5049.753-5049.709=0.044
mean2772.000-2652.000=120.000
σ0.000
min2772.000-2652.000=120.000
max2772.000-2652.000=120.000
mean8.721-8.980=-0.258
σ0.377-0.557=-0.180
min8.096-8.163=-0.067
max9.081-9.597=-0.515
iters=5
new-facts=6402
prior-facts=6402
mean5179.241-5179.097=0.144
σ0.083-0.341=-0.259
min5179.172-5178.501=0.671
max5179.335-5179.328=0.007
mean3234.600-3225.600=9.000
σ363.081-369.873=-6.792
min2772.000-2697.000=75.000
max3728.000-3678.000=50.000
mean9.932-9.951=-0.018
σ0.223-0.198=0.025
min9.550-9.610=-0.059
max10.117-10.118=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.039-1.127=-0.087
σ0.141-0.272=-0.131
min0.946-0.936=0.011
max1.264-1.542=-0.278

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.574-463.576=-0.002
σ572.650-572.674=-0.024
min177.243-177.236=0.007
max1322.549-1322.587=-0.038
mean79.750
σ7.500
min76.000
max91.000
mean2772.000-2652.000=120.000
σ0.000
min2772.000-2652.000=120.000
max2772.000-2652.000=120.000
mean0.443-0.548=-0.105
σ0.309-0.532=-0.223
min0.286-0.276=0.009
max0.906-1.345=-0.439
policies=20
mean1772.658-1772.616=0.042
σ0.326-0.332=-0.006
min1772.419-1772.400=0.019
max1773.135-1773.109=0.025
mean760.000
σ0.000
min760.000
max760.000
mean2772.000-2652.000=120.000
σ0.000
min2772.000-2652.000=120.000
max2772.000-2652.000=120.000
mean2.848-2.754=0.094
σ0.128-0.020=0.108
min2.758-2.731=0.027
max3.031-2.779=0.252
policies=200
mean17733.040-17732.916=0.124
σ0.496-0.425=0.071
min17732.722-17732.550=0.172
max17733.780-17733.521=0.259
mean7600.000
σ0.000
min7600.000
max7600.000
mean2772.000-2652.000=120.000
σ0.000
min2772.000-2652.000=120.000
max2772.000-2652.000=120.000
mean27.881-27.743=0.138
σ0.204-0.089=0.115
min27.633-27.649=-0.016
max28.122-27.847=0.275