Compare commits

Home / Compare d6324f8a .. 142fc2c8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.980-33.979=0.001
σ0.050-0.049=0.001
min33.951-33.946=0.004
max34.118-34.113=0.005
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.084-0.085=-0.001
σ0.003-0.004=-0.001
min0.081-0.082=-0.001
max0.090-0.091=-0.001
cache=y
dps=1
iters=10
policies=100
mean23.318-23.317=0.001
σ0.003-0.003=0.000
min23.314-23.313=0.001
max23.324-23.320=0.004
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.066-0.062=0.003
σ0.002-0.003=-0.000
min0.063-0.060=0.003
max0.072-0.069=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.493-1757.303=0.190
σ0.363-0.366=-0.002
min1756.922-1756.728=0.195
max1758.081-1757.896=0.185
mean1671.750-1651.950=19.800
σ643.795-627.598=16.197
min677.000-675.000=2.000
max2650.000-2600.000=50.000
mean2.378-2.335=0.043
σ0.116-0.127=-0.012
min2.256-2.202=0.054
max2.728-2.644=0.084

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.638-326.453=0.185
σ0.050-0.032=0.018
min326.549-326.399=0.151
max326.673-326.475=0.198
mean2650.000-2600.000=50.000
σ0.000
min2650.000-2600.000=50.000
max2650.000-2600.000=50.000
mean0.428-0.423=0.005
σ0.006-0.002=0.004
min0.423-0.420=0.003
max0.435-0.425=0.010
iters=5
new-facts=1
prior-facts=6402
mean1988.807-1988.602=0.206
σ0.007-0.032=-0.025
min1988.796-1988.549=0.246
max1988.813-1988.626=0.187
mean2650.000-2600.000=50.000
σ0.000
min2650.000-2600.000=50.000
max2650.000-2600.000=50.000
mean2.702-2.700=0.001
σ0.086-0.178=-0.092
min2.598-2.581=0.017
max2.799-3.015=-0.216
iters=5
new-facts=6402
prior-facts=1
mean4813.427-4813.508=-0.081
σ7.872-7.706=0.166
min4809.065-4809.898=-0.833
max4827.480-4827.291=0.189
mean2650.000-2600.000=50.000
σ0.000
min2650.000-2600.000=50.000
max2650.000-2600.000=50.000
mean8.737-8.407=0.331
σ0.483-0.609=-0.126
min8.076-7.710=0.366
max9.161-9.314=-0.152
iters=5
new-facts=6402
prior-facts=6402
mean5001.207-5001.022=0.186
σ0.046-0.031=0.014
min5001.158-5000.987=0.170
max5001.271-5001.056=0.215
mean3011.200-2961.200=50.000
σ266.130-266.229=-0.099
min2650.000-2626.000=24.000
max3353.000-3323.000=30.000
mean9.500-9.927=-0.427
σ0.623-0.188=0.435
min8.487-9.706=-1.219
max10.165-10.219=-0.054

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.187-1.162=0.026
σ0.360-0.334=0.026
min0.920-0.917=0.002
max1.789-1.731=0.058

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.634-464.437=0.198
σ574.778-574.785=-0.007
min177.238-177.039=0.199
max1326.802-1326.614=0.188
mean88.250
σ8.500
min84.000
max101.000
mean2650.000-2600.000=50.000
σ0.000
min2650.000-2600.000=50.000
max2650.000-2600.000=50.000
mean0.552-0.550=0.002
σ0.558-0.553=0.005
min0.270-0.271=-0.001
max1.389-1.380=0.009
policies=20
mean1772.685-1770.769=1.916
σ0.357-0.358=-0.000
min1772.444-1770.533=1.911
max1773.215-1771.301=1.914
mean840.000
σ0.000
min840.000
max840.000
mean2650.000-2600.000=50.000
σ0.000
min2650.000-2600.000=50.000
max2650.000-2600.000=50.000
mean2.729-2.724=0.005
σ0.019-0.025=-0.005
min2.707-2.694=0.013
max2.752-2.753=-0.000
policies=200
mean17733.908-17714.788=19.121
σ0.565-0.609=-0.044
min17733.620-17714.352=19.268
max17734.755-17715.686=19.070
mean8400.000
σ0.000
min8400.000
max8400.000
mean2650.000-2600.000=50.000
σ0.000
min2650.000-2600.000=50.000
max2650.000-2600.000=50.000
mean27.585-27.398=0.186
σ0.081-0.127=-0.046
min27.513-27.224=0.289
max27.658-27.507=0.152