Compare commits

Home / Compare 0c05653f .. 22c18d1d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.567-70.397=0.170
σ0.046-0.045=0.000
min70.539-70.372=0.167
max70.692-70.522=0.170
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.159-0.160=-0.000
σ0.004-0.003=0.000
min0.154-0.155=-0.002
max0.165-0.166=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.288-21.146=0.143
σ0.002-0.004=-0.002
min21.285-21.141=0.144
max21.291-21.155=0.136
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.065=-0.000
σ0.003-0.003=-0.000
min0.063-0.063=-0.000
max0.072-0.074=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.570-1752.698=0.871
σ0.360-0.361=-0.002
min1752.999-1752.128=0.871
max1754.154-1753.300=0.854
mean1658.400-1660.100=-1.700
σ632.078-631.900=0.178
min645.000-619.000=26.000
max2855.000-2771.000=84.000
mean2.733-2.807=-0.073
σ0.270-0.199=0.072
min2.166-2.254=-0.088
max3.165-3.092=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.020-270.584=1.436
σ0.005-0.008=-0.003
min272.015-270.573=1.442
max272.027-270.591=1.436
mean2855.000-2771.000=84.000
σ0.000
min2855.000-2771.000=84.000
max2855.000-2771.000=84.000
mean0.392-0.388=0.004
σ0.009-0.011=-0.002
min0.380-0.379=0.001
max0.404-0.401=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.443-1931.056=1.387
σ0.005-0.016=-0.011
min1932.437-1931.040=1.398
max1932.450-1931.078=1.372
mean2855.000-2771.000=84.000
σ0.000
min2855.000-2771.000=84.000
max2855.000-2771.000=84.000
mean2.937-2.888=0.048
σ0.089-0.236=-0.147
min2.836-2.492=0.344
max3.064-3.106=-0.042
iters=5
new-facts=6402
prior-facts=1
mean4752.873-4751.799=1.074
σ0.768-0.844=-0.076
min4752.108-4751.282=0.826
max4754.121-4753.297=0.824
mean2855.000-2771.000=84.000
σ0.000
min2855.000-2771.000=84.000
max2855.000-2771.000=84.000
mean8.196-8.276=-0.080
σ0.619-0.489=0.130
min7.689-7.659=0.030
max9.139-8.896=0.243
iters=5
new-facts=6402
prior-facts=6402
mean4943.560-4942.235=1.325
σ0.161-0.021=0.141
min4943.273-4942.213=1.059
max4943.648-4942.265=1.383
mean3067.800-3055.200=12.600
σ277.793-255.268=22.525
min2855.000-2771.000=84.000
max3498.000-3413.000=85.000
mean8.495-8.568=-0.073
σ0.191-0.165=0.025
min8.381-8.420=-0.039
max8.829-8.831=-0.002

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.082=-0.056
σ0.141-0.158=-0.016
min0.933-0.930=0.003
max1.255-1.254=0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.082-467.211=5.871
σ575.916-575.933=-0.017
min185.115-179.237=5.878
max1336.955-1331.111=5.845
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2855.000-2771.000=84.000
σ0.000
min2855.000-2771.000=84.000
max2855.000-2771.000=84.000
mean0.449-0.449=0.000
σ0.300-0.311=-0.010
min0.294-0.292=0.001
max0.900-0.915=-0.015
policies=20
mean1851.443-1792.626=58.817
σ0.367-0.335=0.032
min1851.173-1792.378=58.794
max1851.976-1793.119=58.858
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2855.000-2771.000=84.000
σ0.000
min2855.000-2771.000=84.000
max2855.000-2771.000=84.000
mean2.949-2.832=0.117
σ0.009-0.085=-0.076
min2.938-2.775=0.163
max2.957-2.958=-0.001
policies=200
mean18521.135-17933.052=588.083
σ0.504-0.492=0.012
min18520.793-17932.747=588.046
max18521.883-17933.784=588.098
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2855.000-2771.000=84.000
σ0.000
min2855.000-2771.000=84.000
max2855.000-2771.000=84.000
mean29.245-28.112=1.132
σ0.531-0.125=0.405
min28.780-27.965=0.815
max29.718-28.268=1.450