Compare commits

Home / Compare cd19de68 .. 513d038b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.001
σ0.049-0.050=-0.001
min31.008-31.002=0.006
max31.178-31.179=-0.001
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.080-0.079=0.000
σ0.003-0.004=-0.001
min0.077-0.076=0.001
max0.086-0.088=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.143-21.142=0.001
σ0.003-0.002=0.001
min21.138-21.139=-0.001
max21.150-21.145=0.005
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.064-0.062=0.001
σ0.005-0.004=0.000
min0.058-0.057=0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.412=0.001
σ0.363-0.361=0.002
min1750.845-1750.845=0.000
max1752.001-1752.000=0.001
mean1653.900-1654.000=-0.100
σ645.570-646.964=-1.394
min631.000-639.000=-8.000
max2850.000
mean2.857-2.847=0.010
σ0.163-0.169=-0.006
min2.407-2.453=-0.045
max3.077-3.293=-0.216

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.782-266.781=0.000
σ0.018-0.005=0.013
min266.751-266.776=-0.026
max266.798-266.789=0.009
mean2850.000
σ0.000
min2850.000
max2850.000
mean0.371-0.368=0.003
σ0.009-0.006=0.003
min0.361-0.364=-0.003
max0.380-0.378=0.003
iters=5
new-facts=1
prior-facts=6402
mean1927.220-1927.208=0.012
σ0.015-0.007=0.009
min1927.201-1927.201=-0.000
max1927.239-1927.215=0.024
mean2850.000
σ0.000
min2850.000
max2850.000
mean2.843-3.003=-0.159
σ0.196-0.148=0.048
min2.617-2.856=-0.239
max3.076-3.252=-0.175
iters=5
new-facts=6402
prior-facts=1
mean4747.663-4747.707=-0.044
σ0.851-0.790=0.060
min4746.856-4747.160=-0.304
max4749.109-4749.107=0.002
mean2850.000
σ0.000
min2850.000
max2850.000
mean8.078-8.544=-0.466
σ0.364-0.523=-0.159
min7.675-7.671=0.004
max8.652-9.039=-0.387
iters=5
new-facts=6402
prior-facts=6402
mean4938.165-4938.168=-0.002
σ0.088-0.089=-0.001
min4938.089-4938.093=-0.004
max4938.267-4938.268=-0.001
mean3053.000-3033.800=19.200
σ256.679-192.073=64.605
min2850.000
max3434.000-3309.000=125.000
mean8.418-8.469=-0.052
σ0.119-0.165=-0.046
min8.289-8.242=0.047
max8.586-8.679=-0.092

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.029-1.078=-0.049
σ0.139-0.176=-0.037
min0.931-0.935=-0.004
max1.254-1.370=-0.116

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.123-465.124=-0.001
σ575.755-575.763=-0.009
min177.237-177.232=0.005
max1328.755-1328.769=-0.014
mean79.750
σ7.500
min76.000
max91.000
mean2850.000
σ0.000
min2850.000
max2850.000
mean0.440-0.437=0.003
σ0.306-0.308=-0.001
min0.284-0.281=0.003
max0.899-0.899=0.000
policies=20
mean1772.630-1772.626=0.004
σ0.333-0.341=-0.008
min1772.394-1772.366=0.029
max1773.120-1773.124=-0.004
mean760.000
σ0.000
min760.000
max760.000
mean2850.000
σ0.000
min2850.000
max2850.000
mean2.831-2.853=-0.022
σ0.013-0.017=-0.004
min2.817-2.838=-0.021
max2.848-2.877=-0.029
policies=200
mean17732.541-17732.430=0.111
σ0.425-0.536=-0.111
min17732.272-17732.055=0.217
max17733.174-17733.204=-0.030
mean7600.000
σ0.000
min7600.000
max7600.000
mean2850.000
σ0.000
min2850.000
max2850.000
mean28.140-28.180=-0.040
σ0.435-0.412=0.023
min27.642-27.731=-0.089
max28.523-28.548=-0.025