Compare commits

Home / Compare 2a5bd02c .. da7954c4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.839-53.836=0.003
σ0.368-0.368=-0.000
min53.696-53.693=0.003
max54.886-54.883=0.003
mean416.000
σ0.000
min416.000
max416.000
mean0.139-0.138=0.001
σ0.003-0.004=-0.001
min0.135-0.132=0.004
max0.143-0.144=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.207-43.207=-0.000
σ0.007-0.007=-0.000
min43.196-43.196=0.000
max43.221-43.221=-0.000
mean416.000
σ0.000
min416.000
max416.000
mean0.114-0.119=-0.005
σ0.009-0.005=0.004
min0.092-0.114=-0.022
max0.120-0.126=-0.006

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.204-1016.206=-0.002
σ1.196-1.165=0.032
min1015.663-1015.657=0.006
max1021.216-1021.081=0.135
mean1040.450-1042.150=-1.700
σ312.903-310.346=2.557
min556.000-588.000=-32.000
max1629.000
mean1.573-1.557=0.015
σ0.092-0.070=0.022
min1.488-1.489=-0.001
max1.810-1.799=0.012

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.531-301.407=0.123
σ0.156-0.238=-0.082
min301.369-301.204=0.165
max301.921-302.043=-0.122
mean1941.000-1950.000=-9.000
σ0.000
min1941.000-1950.000=-9.000
max1941.000-1950.000=-9.000
mean0.551-0.593=-0.041
σ0.035-0.028=0.007
min0.501-0.517=-0.016
max0.596-0.610=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean301.483-301.469=0.014
σ0.045-0.064=-0.018
min301.417-301.364=0.053
max301.529-301.526=0.003
mean1629.000
σ0.000
min1629.000
max1629.000
mean0.394-0.390=0.004
σ0.011-0.001=0.010
min0.386-0.389=-0.003
max0.408-0.392=0.016
iters=5
new-facts=1
prior-facts=6402
mean1324.053-1324.048=0.005
σ0.105-0.104=0.001
min1323.928-1323.919=0.009
max1324.208-1324.197=0.012
mean1629.000
σ0.000
min1629.000
max1629.000
mean1.954-1.900=0.054
σ0.128-0.069=0.059
min1.838-1.815=0.023
max2.158-1.984=0.175
iters=5
new-facts=6402
prior-facts=1
mean1562.097-1562.095=0.002
σ6.932-6.936=-0.005
min1558.753-1558.725=0.028
max1574.489-1574.496=-0.007
mean1629.000
σ0.000
min1629.000
max1629.000
mean2.394-2.390=0.003
σ0.357-0.344=0.014
min2.009-2.105=-0.096
max2.889-2.891=-0.002
iters=5
new-facts=6402
prior-facts=6402
mean1891.981-1891.983=-0.002
σ0.082-0.073=0.008
min1891.838-1891.853=-0.015
max1892.043-1892.032=0.011
mean1795.000-1780.200=14.800
σ118.844-115.697=3.148
min1629.000
max1941.000-1950.000=-9.000
mean2.995-2.969=0.027
σ0.182-0.142=0.040
min2.871-2.863=0.008
max3.313-3.206=0.106

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.199-1.209=-0.010
σ0.326-0.280=0.046
min0.910-0.918=-0.008
max1.747-1.656=0.090

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.545-443.493=0.052
σ574.353-574.249=0.105
min156.367-156.368=-0.000
max1305.075-1304.866=0.210
mean96.250
σ8.500
min92.000
max109.000
mean1629.000
σ0.000
min1629.000
max1629.000
mean0.531-0.531=-0.001
σ0.543-0.539=0.004
min0.259-0.260=-0.001
max1.345-1.340=0.005
policies=20
mean1563.917-1563.921=-0.004
σ0.321-0.327=-0.006
min1563.737-1563.738=-0.001
max1564.398-1564.411=-0.013
mean920.000
σ0.000
min920.000
max920.000
mean1629.000
σ0.000
min1629.000
max1629.000
mean2.612-2.619=-0.007
σ0.005-0.017=-0.012
min2.606-2.606=0.001
max2.618-2.642=-0.024
policies=200
mean15646.998-15647.016=-0.018
σ0.061-0.077=-0.015
min15646.944-15646.952=-0.008
max15647.063-15647.128=-0.065
mean9200.000
σ0.000
min9200.000
max9200.000
mean1629.000
σ0.000
min1629.000
max1629.000
mean26.419-26.510=-0.091
σ0.231-0.180=0.051
min26.168-26.337=-0.169
max26.656-26.734=-0.078