Compare commits

Home / Compare a4eb0b36 .. 653a77fa

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.994-33.994=-0.000
σ0.052-0.051=0.000
min33.955-33.969=-0.014
max34.139-34.139=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.085=-0.000
σ0.003-0.004=-0.001
min0.082-0.081=0.001
max0.091-0.092=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.318=0.000
σ0.003-0.003=0.000
min23.315-23.315=-0.000
max23.324-23.323=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.066-0.064=0.002
σ0.003-0.003=-0.000
min0.063-0.060=0.003
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1762.685-1762.565=0.121
σ0.365-0.367=-0.002
min1762.116-1761.992=0.124
max1763.285-1763.155=0.130
mean1655.950-1640.500=15.450
σ624.419-601.297=23.122
min665.000-628.000=37.000
max2609.000-2446.000=163.000
mean2.488-2.350=0.138
σ0.231-0.115=0.116
min2.194-2.147=0.047
max2.997-2.670=0.326

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean339.177-339.052=0.125
σ0.059-0.061=-0.001
min339.072-338.943=0.128
max339.211-339.081=0.130
mean2609.000-2446.000=163.000
σ0.000
min2609.000-2446.000=163.000
max2609.000-2446.000=163.000
mean0.432-0.436=-0.004
σ0.001-0.003=-0.002
min0.431-0.433=-0.002
max0.433-0.441=-0.007
iters=5
new-facts=1
prior-facts=6402
mean2003.806-2003.676=0.129
σ0.014-0.007=0.007
min2003.793-2003.670=0.123
max2003.827-2003.683=0.143
mean2609.000-2446.000=163.000
σ0.000
min2609.000-2446.000=163.000
max2609.000-2446.000=163.000
mean3.208-3.034=0.174
σ0.071-0.283=-0.212
min3.148-2.635=0.513
max3.317-3.306=0.011
iters=5
new-facts=6402
prior-facts=1
mean4828.554-4828.196=0.357
σ7.684-7.888=-0.204
min4825.030-4824.372=0.658
max4842.298-4842.301=-0.002
mean2609.000-2446.000=163.000
σ0.000
min2609.000-2446.000=163.000
max2609.000-2446.000=163.000
mean8.444-8.803=-0.360
σ0.399-0.442=-0.043
min7.936-8.204=-0.268
max8.937-9.238=-0.300
iters=5
new-facts=6402
prior-facts=6402
mean5016.060-5016.082=-0.022
σ0.329-0.015=0.314
min5015.472-5016.063=-0.591
max5016.218-5016.105=0.113
mean2984.400-2992.000=-7.600
σ295.647-312.476=-16.829
min2609.000-2576.000=33.000
max3371.000-3384.000=-13.000
mean8.634-8.689=-0.055
σ0.168-0.200=-0.032
min8.428-8.473=-0.046
max8.846-8.902=-0.056

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.185-1.725=-0.541
σ0.313-0.052=0.261
min0.918-1.660=-0.742
max1.684-1.789=-0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.158-468.020=0.138
σ575.293-575.281=0.012
min180.506-180.374=0.132
max1331.097-1330.941=0.156
mean92.250
σ8.500
min88.000
max105.000
mean2609.000-2446.000=163.000
σ0.000
min2609.000-2446.000=163.000
max2609.000-2446.000=163.000
mean0.549-0.554=-0.005
σ0.534-0.556=-0.022
min0.281-0.273=0.008
max1.350-1.388=-0.038
policies=20
mean1805.350-1804.081=1.269
σ0.391-0.398=-0.008
min1805.103-1803.834=1.269
max1805.931-1804.675=1.255
mean880.000
σ0.000
min880.000
max880.000
mean2609.000-2446.000=163.000
σ0.000
min2609.000-2446.000=163.000
max2609.000-2446.000=163.000
mean2.793-2.759=0.034
σ0.042-0.009=0.033
min2.764-2.751=0.013
max2.855-2.772=0.084
policies=200
mean18061.005-18048.439=12.566
σ0.625-0.627=-0.002
min18060.654-18048.095=12.559
max18061.941-18049.379=12.562
mean8800.000
σ0.000
min8800.000
max8800.000
mean2609.000-2446.000=163.000
σ0.000
min2609.000-2446.000=163.000
max2609.000-2446.000=163.000
mean27.922-27.880=0.042
σ0.154-0.200=-0.046
min27.786-27.694=0.091
max28.107-28.147=-0.041