Compare commits

Home / Compare 9670f421 .. c442c2c2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.039=0.001
σ0.048-0.050=-0.002
min31.004-30.999=0.004
max31.174-31.178=-0.004
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.079-0.076=0.003
σ0.004-0.005=-0.001
min0.072-0.072=0.000
max0.087-0.088=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.001
σ0.003-0.002=0.001
min21.139-21.140=-0.001
max21.148-21.148=-0.000
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.062-0.063=-0.001
σ0.003-0.004=-0.000
min0.058-0.058=-0.000
max0.066-0.070=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.412-1751.412=-0.000
σ0.360-0.363=-0.003
min1750.839-1750.835=0.004
max1751.981-1752.005=-0.024
mean1640.200-1650.400=-10.200
σ615.414-643.363=-27.949
min630.000-631.000=-1.000
max2474.000-2857.000=-383.000
mean2.815-2.748=0.067
σ0.142-0.180=-0.038
min2.362-2.144=0.218
max3.002-2.946=0.056

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.783-266.763=0.020
σ0.006-0.017=-0.011
min266.776-266.749=0.027
max266.791-266.793=-0.002
mean2474.000-2857.000=-383.000
σ0.000
min2474.000-2857.000=-383.000
max2474.000-2857.000=-383.000
mean0.364-0.365=-0.000
σ0.001-0.001=-0.000
min0.363-0.363=-0.000
max0.366-0.366=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1927.212-1927.216=-0.004
σ0.014-0.010=0.004
min1927.193-1927.202=-0.009
max1927.227-1927.230=-0.003
mean2474.000-2857.000=-383.000
σ0.000
min2474.000-2857.000=-383.000
max2474.000-2857.000=-383.000
mean3.060-2.999=0.061
σ0.109-0.096=0.013
min2.972-2.876=0.096
max3.245-3.114=0.130
iters=5
new-facts=6402
prior-facts=1
mean4747.660-4747.728=-0.068
σ0.467-0.782=-0.315
min4747.379-4747.343=0.035
max4748.484-4749.125=-0.641
mean2474.000-2857.000=-383.000
σ0.000
min2474.000-2857.000=-383.000
max2474.000-2857.000=-383.000
mean7.870-8.240=-0.370
σ0.270-0.620=-0.350
min7.637-7.675=-0.039
max8.334-9.011=-0.677
iters=5
new-facts=6402
prior-facts=6402
mean4938.166-4938.170=-0.004
σ0.075-0.091=-0.016
min4938.106-4938.086=0.020
max4938.249-4938.272=-0.024
mean2963.800-3088.400=-124.600
σ430.332-310.236=120.096
min2474.000-2857.000=-383.000
max3544.000-3572.000=-28.000
mean8.466-8.517=-0.052
σ0.170-0.279=-0.109
min8.332-8.285=0.047
max8.753-8.953=-0.201

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.778-1.110=0.668
σ0.120-0.160=-0.040
min1.642-0.942=0.700
max1.892-1.377=0.515

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.114-465.129=-0.014
σ575.753-575.766=-0.014
min177.235-177.239=-0.004
max1328.743-1328.778=-0.035
mean79.750
σ7.500
min76.000
max91.000
mean2474.000-2857.000=-383.000
σ0.000
min2474.000-2857.000=-383.000
max2474.000-2857.000=-383.000
mean0.562-0.441=0.120
σ0.571-0.310=0.262
min0.273-0.283=-0.009
max1.418-0.906=0.513
policies=20
mean1772.605-1772.635=-0.029
σ0.327-0.335=-0.008
min1772.389-1772.397=-0.008
max1773.090-1773.130=-0.039
mean760.000
σ0.000
min760.000
max760.000
mean2474.000-2857.000=-383.000
σ0.000
min2474.000-2857.000=-383.000
max2474.000-2857.000=-383.000
mean2.736-2.823=-0.087
σ0.011-0.015=-0.004
min2.720-2.814=-0.095
max2.746-2.846=-0.100
policies=200
mean17732.585-17732.766=-0.182
σ0.604-0.459=0.145
min17732.228-17732.406=-0.178
max17733.488-17733.438=0.050
mean7600.000
σ0.000
min7600.000
max7600.000
mean2474.000-2857.000=-383.000
σ0.000
min2474.000-2857.000=-383.000
max2474.000-2857.000=-383.000
mean27.665-28.173=-0.508
σ0.090-0.554=-0.464
min27.605-27.626=-0.022
max27.798-28.757=-0.958