Compare commits

Home / Compare 62fcc42b .. 2a1b0a5a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.822=0.001
σ0.368-0.368=-0.000
min53.678-53.676=0.002
max54.870-54.869=0.000
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.135-0.139=-0.004
σ0.005-0.004=0.002
min0.129-0.135=-0.007
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.007-0.005=0.003
min43.196-43.198=-0.003
max43.221-43.213=0.007
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.121-0.120=0.001
σ0.005-0.005=0.000
min0.114-0.113=0.001
max0.129-0.128=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.180-1016.177=0.003
σ1.151-1.170=-0.019
min1015.612-1015.626=-0.014
max1020.989-1021.078=-0.089
mean1054.300-1043.700=10.600
σ312.541-311.278=1.264
min589.000
max1674.000-1635.000=39.000
mean1.585-1.567=0.018
σ0.085-0.078=0.006
min1.491-1.499=-0.008
max1.829-1.812=0.016

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.488-301.294=0.194
σ0.223-0.190=0.033
min301.285-301.101=0.183
max302.082-301.754=0.328
mean2030.000-2036.000=-6.000
σ0.000
min2030.000-2036.000=-6.000
max2030.000-2036.000=-6.000
mean0.575-0.543=0.031
σ0.026-0.033=-0.007
min0.504-0.494=0.010
max0.594-0.576=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.699-300.695=0.004
σ0.022-0.030=-0.008
min300.673-300.642=0.031
max300.727-300.719=0.008
mean1674.000-1635.000=39.000
σ0.000
min1674.000-1635.000=39.000
max1674.000-1635.000=39.000
mean0.396-0.398=-0.003
σ0.008-0.008=-0.001
min0.390-0.388=0.002
max0.404-0.407=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1322.868-1322.866=0.003
σ0.095-0.088=0.007
min1322.812-1322.817=-0.004
max1323.036-1323.022=0.014
mean1674.000-1635.000=39.000
σ0.000
min1674.000-1635.000=39.000
max1674.000-1635.000=39.000
mean1.940-1.873=0.067
σ0.094-0.073=0.020
min1.836-1.812=0.024
max2.064-1.954=0.110
iters=5
new-facts=6402
prior-facts=1
mean1561.339-1561.317=0.022
σ6.847-6.892=-0.044
min1558.048-1558.026=0.022
max1573.583-1573.641=-0.057
mean1674.000-1635.000=39.000
σ0.000
min1674.000-1635.000=39.000
max1674.000-1635.000=39.000
mean2.372-2.341=0.031
σ0.194-0.333=-0.139
min2.066-2.040=0.026
max2.572-2.705=-0.132
iters=5
new-facts=6402
prior-facts=6402
mean1890.788-1890.779=0.008
σ0.020-0.029=-0.009
min1890.764-1890.740=0.024
max1890.814-1890.818=-0.005
mean1787.800-1774.200=13.600
σ153.565-170.111=-16.546
min1674.000-1635.000=39.000
max2030.000-2036.000=-6.000
mean2.936-2.872=0.064
σ0.050-0.194=-0.144
min2.901-2.583=0.318
max3.025-3.131=-0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.170-1.152=0.018
σ0.367-0.177=0.190
min0.901-1.007=-0.106
max1.784-1.423=0.360

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.333-443.046=0.287
σ573.992-573.417=0.574
min156.332-156.334=-0.001
max1304.321-1303.172=1.148
mean96.250
σ8.500
min92.000
max109.000
mean1674.000-1635.000=39.000
σ0.000
min1674.000-1635.000=39.000
max1674.000-1635.000=39.000
mean0.569-0.543=0.026
σ0.612-0.558=0.054
min0.261-0.262=-0.000
max1.488-1.380=0.108
policies=20
mean1563.617-1563.635=-0.018
σ0.318-0.337=-0.020
min1563.442-1563.442=-0.000
max1564.093-1564.140=-0.048
mean920.000
σ0.000
min920.000
max920.000
mean1674.000-1635.000=39.000
σ0.000
min1674.000-1635.000=39.000
max1674.000-1635.000=39.000
mean2.607-2.628=-0.021
σ0.012-0.009=0.002
min2.591-2.620=-0.029
max2.616-2.640=-0.024
policies=200
mean15644.086-15644.132=-0.046
σ0.074-0.044=0.030
min15643.992-15644.070=-0.078
max15644.172-15644.173=-0.001
mean9200.000
σ0.000
min9200.000
max9200.000
mean1674.000-1635.000=39.000
σ0.000
min1674.000-1635.000=39.000
max1674.000-1635.000=39.000
mean26.509-26.595=-0.085
σ0.182-0.130=0.053
min26.331-26.480=-0.149
max26.712-26.744=-0.033