Compare commits

Home / Compare 40a46f7a .. 5a5b8a2c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.655-53.654=0.000
σ0.368-0.368=-0.001
min53.517-53.517=0.000
max54.700-54.703=-0.002
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.138-0.138=-0.000
σ0.003-0.003=-0.001
min0.135-0.135=0.000
max0.144-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean42.981-42.981=0.000
σ0.006-0.006=0.000
min42.974-42.974=-0.000
max42.993-42.993=0.001
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.121-0.120=0.001
σ0.004-0.004=0.001
min0.117-0.117=-0.001
max0.128-0.127=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1013.969-1013.974=-0.005
σ1.188-1.170=0.018
min1013.426-1013.428=-0.001
max1018.945-1018.865=0.080
mean1052.300-1046.200=6.100
σ318.016-318.929=-0.912
min600.000-595.000=5.000
max1662.000-1653.000=9.000
mean1.634-1.637=-0.003
σ0.079-0.080=-0.001
min1.561-1.514=0.047
max1.871-1.859=0.011

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean299.117-298.951=0.166
σ0.233-0.266=-0.034
min298.953-298.780=0.173
max299.756-299.687=0.070
mean2025.000-1953.000=72.000
σ0.000
min2025.000-1953.000=72.000
max2025.000-1953.000=72.000
mean0.612-0.597=0.015
σ0.022-0.037=-0.016
min0.561-0.554=0.007
max0.629-0.653=-0.025

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean294.675-294.668=0.006
σ0.019-0.022=-0.003
min294.661-294.635=0.026
max294.707-294.688=0.020
mean1662.000-1653.000=9.000
σ0.000
min1662.000-1653.000=9.000
max1662.000-1653.000=9.000
mean0.388-0.390=-0.002
σ0.008-0.009=-0.001
min0.379-0.381=-0.002
max0.396-0.400=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1316.930-1316.941=-0.012
σ0.106-0.105=0.001
min1316.851-1316.885=-0.034
max1317.114-1317.129=-0.015
mean1662.000-1653.000=9.000
σ0.000
min1662.000-1653.000=9.000
max1662.000-1653.000=9.000
mean1.954-2.025=-0.072
σ0.109-0.118=-0.009
min1.850-1.890=-0.040
max2.137-2.166=-0.028
iters=5
new-facts=6402
prior-facts=1
mean1555.286-1555.311=-0.025
σ6.859-6.827=0.031
min1551.990-1552.005=-0.015
max1567.549-1567.518=0.031
mean1662.000-1653.000=9.000
σ0.000
min1662.000-1653.000=9.000
max1662.000-1653.000=9.000
mean2.271-2.307=-0.036
σ0.211-0.104=0.107
min2.143-2.162=-0.018
max2.645-2.424=0.221
iters=5
new-facts=6402
prior-facts=6402
mean1884.776-1884.782=-0.005
σ0.041-0.022=0.019
min1884.742-1884.757=-0.015
max1884.846-1884.816=0.030
mean1785.400-1792.800=-7.400
σ156.276-151.724=4.552
min1662.000-1653.000=9.000
max2025.000-1953.000=72.000
mean2.923-3.178=-0.256
σ0.322-0.386=-0.064
min2.672-2.895=-0.223
max3.466-3.855=-0.389

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.204=-0.148
σ0.208-0.369=-0.161
min0.903-0.918=-0.015
max1.334-1.830=-0.496

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.670-440.666=0.004
σ573.396-573.396=0.001
min153.961-153.961=0.000
max1300.764-1300.760=0.004
mean96.250
σ8.500
min92.000
max109.000
mean1662.000-1653.000=9.000
σ0.000
min1662.000-1653.000=9.000
max1662.000-1653.000=9.000
mean0.538-0.543=-0.005
σ0.553-0.565=-0.012
min0.261-0.258=0.003
max1.368-1.391=-0.023
policies=20
mean1539.844-1539.866=-0.022
σ0.315-0.315=0.000
min1539.661-1539.688=-0.026
max1540.315-1540.337=-0.022
mean920.000
σ0.000
min920.000
max920.000
mean1662.000-1653.000=9.000
σ0.000
min1662.000-1653.000=9.000
max1662.000-1653.000=9.000
mean2.598-2.597=0.001
σ0.010-0.018=-0.008
min2.584-2.572=0.012
max2.609-2.613=-0.004
policies=200
mean15406.508-15406.468=0.040
σ0.158-0.133=0.025
min15406.376-15406.320=0.056
max15406.715-15406.627=0.087
mean9200.000
σ0.000
min9200.000
max9200.000
mean1662.000-1653.000=9.000
σ0.000
min1662.000-1653.000=9.000
max1662.000-1653.000=9.000
mean26.253-26.307=-0.054
σ0.138-0.178=-0.040
min26.098-26.137=-0.039
max26.407-26.479=-0.073