Compare commits

Home / Compare f18b3a46 .. 7d64bd59

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.697-70.699=-0.002
σ0.050-0.044=0.006
min70.671-70.673=-0.001
max70.838-70.820=0.018
mean414.600-414.000=0.600
σ0.516-0.000=0.516
min414.000
max415.000-414.000=1.000
mean0.162-0.162=0.000
σ0.004-0.003=0.001
min0.158-0.158=-0.000
max0.169-0.167=0.002
cache=y
dps=1
iters=10
policies=100
mean21.424-21.421=0.003
σ0.012-0.003=0.009
min21.415-21.416=-0.000
max21.457-21.427=0.030
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.067-0.066=0.001
σ0.003-0.003=0.000
min0.064-0.061=0.004
max0.075-0.071=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.457-1754.460=-0.003
σ0.360-0.362=-0.002
min1753.882-1753.892=-0.010
max1755.041-1755.036=0.005
mean1661.500-1642.800=18.700
σ643.607-627.992=15.615
min638.000-625.000=13.000
max2862.000-2857.000=5.000
mean2.820-2.795=0.025
σ0.209-0.207=0.002
min2.409-2.252=0.157
max3.391-3.042=0.349

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.505-273.501=0.004
σ0.008-0.017=-0.009
min273.496-273.471=0.025
max273.514-273.513=0.002
mean2862.000-2857.000=5.000
σ0.000
min2862.000-2857.000=5.000
max2862.000-2857.000=5.000
mean0.385-0.377=0.008
σ0.006-0.006=0.000
min0.381-0.372=0.009
max0.396-0.386=0.010
iters=5
new-facts=1
prior-facts=6402
mean1933.890-1933.884=0.005
σ0.012-0.007=0.005
min1933.875-1933.876=-0.001
max1933.906-1933.892=0.014
mean2862.000-2857.000=5.000
σ0.000
min2862.000-2857.000=5.000
max2862.000-2857.000=5.000
mean3.029-2.977=0.052
σ0.032-0.076=-0.044
min3.001-2.908=0.093
max3.075-3.102=-0.026
iters=5
new-facts=6402
prior-facts=1
mean4754.541-4754.622=-0.081
σ0.590-0.902=-0.312
min4754.169-4754.106=0.063
max4755.587-4756.230=-0.643
mean2862.000-2857.000=5.000
σ0.000
min2862.000-2857.000=5.000
max2862.000-2857.000=5.000
mean8.655-8.928=-0.273
σ0.283-0.331=-0.047
min8.334-8.536=-0.202
max9.013-9.433=-0.420
iters=5
new-facts=6402
prior-facts=6402
mean4945.054-4945.114=-0.060
σ0.147-0.018=0.130
min4944.791-4945.095=-0.304
max4945.135-4945.141=-0.006
mean3022.000-3023.000=-1.000
σ182.005-190.062=-8.056
min2862.000-2857.000=5.000
max3306.000-3321.000=-15.000
mean8.652-8.442=0.210
σ0.276-0.083=0.193
min8.446-8.335=0.111
max9.120-8.525=0.595

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.085-1.046=0.040
σ0.114-0.123=-0.009
min0.940-0.932=0.008
max1.260-1.237=0.023

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean473.062-473.079=-0.018
σ575.909-575.913=-0.003
min185.100-185.118=-0.018
max1336.926-1336.948=-0.023
mean88.250
σ8.500
min84.000
max101.000
mean2862.000-2857.000=5.000
σ0.000
min2862.000-2857.000=5.000
max2862.000-2857.000=5.000
mean0.447-0.494=-0.047
σ0.306-0.373=-0.067
min0.291-0.305=-0.014
max0.906-1.053=-0.147
policies=20
mean1851.297-1851.449=-0.152
σ0.369-0.371=-0.001
min1851.042-1851.173=-0.131
max1851.839-1851.988=-0.149
mean840.000
σ0.000
min840.000
max840.000
mean2862.000-2857.000=5.000
σ0.000
min2862.000-2857.000=5.000
max2862.000-2857.000=5.000
mean2.954-2.947=0.006
σ0.015-0.012=0.003
min2.940-2.931=0.008
max2.971-2.958=0.013
policies=200
mean18519.520-18519.847=-0.326
σ0.485-0.744=-0.259
min18519.164-18519.295=-0.131
max18520.236-18520.874=-0.638
mean8400.000
σ0.000
min8400.000
max8400.000
mean2862.000-2857.000=5.000
σ0.000
min2862.000-2857.000=5.000
max2862.000-2857.000=5.000
mean29.226-29.048=0.178
σ0.396-0.409=-0.013
min28.887-28.797=0.090
max29.797-29.657=0.140