Compare commits

Home / Compare 3aaa3c19 .. 4f8efab9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.039-31.041=-0.002
σ0.052-0.051=0.001
min31.002-31.005=-0.003
max31.184-31.183=0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.077-0.079=-0.002
σ0.004-0.003=0.001
min0.071-0.072=-0.001
max0.085-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.002-0.002=-0.000
min21.141-21.140=0.001
max21.146-21.145=0.000
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.064-0.064=0.000
σ0.002-0.004=-0.002
min0.063-0.058=0.005
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.411=0.000
σ0.361-0.361=-0.001
min1750.849-1750.848=0.002
max1751.981-1752.001=-0.020
mean1637.800-1658.100=-20.300
σ615.732-618.575=-2.843
min633.000-639.000=-6.000
max2474.000-2491.000=-17.000
mean2.779-2.809=-0.029
σ0.194-0.174=0.020
min2.137-2.340=-0.203
max3.043-3.147=-0.104

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.781-273.401=-6.620
σ0.007-0.008=-0.001
min266.772-273.394=-6.622
max266.789-273.414=-6.626
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean0.368-0.385=-0.017
σ0.009-0.007=0.002
min0.364-0.379=-0.015
max0.383-0.392=-0.009
iters=5
new-facts=1
prior-facts=6402
mean1927.210-1933.842=-6.632
σ0.010-0.012=-0.001
min1927.202-1933.828=-6.626
max1927.225-1933.852=-6.628
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean3.047-3.042=0.006
σ0.231-0.182=0.048
min2.751-2.744=0.007
max3.386-3.182=0.204
iters=5
new-facts=6402
prior-facts=1
mean4747.697-4754.338=-6.641
σ0.845-0.867=-0.022
min4747.189-4753.754=-6.565
max4749.199-4755.875=-6.676
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean8.543-8.544=-0.000
σ0.495-0.534=-0.039
min7.932-7.699=0.232
max9.157-9.053=0.104
iters=5
new-facts=6402
prior-facts=6402
mean4938.173-4944.800=-6.627
σ0.091-0.073=0.018
min4938.099-4944.740=-6.640
max4938.276-4944.887=-6.612
mean3003.000-3012.800=-9.800
σ272.715-351.222=-78.507
min2612.000-2546.000=66.000
max3337.000-3340.000=-3.000
mean8.667-8.747=-0.080
σ0.267-0.319=-0.052
min8.427-8.434=-0.006
max9.001-9.137=-0.136

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.776-1.659=0.117
σ0.111-0.174=-0.062
min1.618-1.411=0.208
max1.925-1.834=0.092

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.114-463.333=1.781
σ575.753-572.198=3.555
min177.235-177.232=0.003
max1328.743-1321.630=7.113
mean79.750
σ7.500
min76.000
max91.000
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean0.561-0.562=-0.000
σ0.559-0.553=0.007
min0.275-0.279=-0.004
max1.400-1.391=0.010
policies=20
mean1772.576-1772.565=0.010
σ0.326-0.329=-0.003
min1772.364-1772.351=0.013
max1773.060-1773.054=0.006
mean760.000
σ0.000
min760.000
max760.000
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean2.733-2.798=-0.065
σ0.015-0.058=-0.042
min2.711-2.722=-0.012
max2.745-2.857=-0.112
policies=200
mean17732.518-17732.410=0.108
σ0.483-0.592=-0.109
min17732.231-17731.990=0.241
max17733.240-17733.273=-0.033
mean7600.000
σ0.000
min7600.000
max7600.000
mean2474.000-2491.000=-17.000
σ0.000
min2474.000-2491.000=-17.000
max2474.000-2491.000=-17.000
mean27.690-27.751=-0.061
σ0.103-0.119=-0.015
min27.553-27.662=-0.109
max27.780-27.926=-0.146