Compare commits

Home / Compare 5e02aceb .. 273a3a6e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.836-53.836=-0.000
σ0.369-0.368=0.001
min53.686-53.689=-0.003
max54.886-54.884=0.002
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.139-0.137=0.002
σ0.005-0.005=-0.001
min0.131-0.131=0.001
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.208=-0.000
σ0.006-0.006=-0.000
min43.200-43.202=-0.002
max43.219-43.219=-0.000
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.119-0.119=0.000
σ0.004-0.005=-0.000
min0.113-0.114=-0.001
max0.127-0.126=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.205-1016.209=-0.004
σ1.165-1.154=0.011
min1015.629-1015.631=-0.002
max1021.084-1021.032=0.052
mean1042.800-1052.600=-9.800
σ309.225-302.408=6.818
min598.000-604.000=-6.000
max1628.000-1457.000=171.000
mean1.532-1.515=0.017
σ0.102-0.055=0.047
min1.394-1.462=-0.068
max1.780-1.632=0.148

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.356-301.293=0.063
σ0.202-0.212=-0.009
min301.234-301.154=0.080
max301.919-301.874=0.046
mean2030.000-1956.000=74.000
σ0.000
min2030.000-1956.000=74.000
max2030.000-1956.000=74.000
mean0.562-0.549=0.013
σ0.031-0.036=-0.005
min0.497-0.496=0.001
max0.588-0.582=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.714-300.723=-0.008
σ0.029-0.023=0.006
min300.667-300.694=-0.027
max300.739-300.754=-0.015
mean1628.000-1457.000=171.000
σ0.000
min1628.000-1457.000=171.000
max1628.000-1457.000=171.000
mean0.393-0.392=0.002
σ0.009-0.006=0.002
min0.389-0.385=0.004
max0.409-0.401=0.008
iters=5
new-facts=1
prior-facts=6402
mean1322.890-1322.878=0.012
σ0.094-0.104=-0.010
min1322.834-1322.807=0.027
max1323.051-1323.061=-0.010
mean1628.000-1457.000=171.000
σ0.000
min1628.000-1457.000=171.000
max1628.000-1457.000=171.000
mean1.916-1.976=-0.060
σ0.081-0.133=-0.052
min1.827-1.835=-0.008
max2.004-2.177=-0.173
iters=5
new-facts=6402
prior-facts=1
mean1561.374-1561.330=0.044
σ6.868-6.873=-0.005
min1558.031-1557.986=0.046
max1573.654-1573.617=0.036
mean1628.000-1457.000=171.000
σ0.000
min1628.000-1457.000=171.000
max1628.000-1457.000=171.000
mean2.428-2.347=0.081
σ0.318-0.237=0.081
min2.054-2.100=-0.046
max2.732-2.616=0.116
iters=5
new-facts=6402
prior-facts=6402
mean1890.809-1890.821=-0.012
σ0.017-0.043=-0.026
min1890.784-1890.794=-0.010
max1890.830-1890.896=-0.066
mean1776.800-1764.000=12.800
σ174.318-155.702=18.616
min1628.000-1529.000=99.000
max2030.000-1956.000=74.000
mean2.894-3.098=-0.204
σ0.160-0.199=-0.040
min2.720-2.895=-0.175
max3.156-3.317=-0.161

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.740=-0.534
σ0.309-0.057=0.252
min0.908-1.685=-0.777
max1.675-1.811=-0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.491-443.475=0.016
σ574.244-574.225=0.019
min156.367-156.356=0.011
max1304.857-1304.813=0.044
mean96.250
σ8.500
min92.000
max109.000
mean1628.000-1457.000=171.000
σ0.000
min1628.000-1457.000=171.000
max1628.000-1457.000=171.000
mean0.537-0.541=-0.003
σ0.551-0.559=-0.008
min0.260-0.256=0.003
max1.364-1.379=-0.015
policies=20
mean1563.921-1563.895=0.025
σ0.340-0.349=-0.009
min1563.728-1563.678=0.050
max1564.430-1564.417=0.013
mean920.000
σ0.000
min920.000
max920.000
mean1628.000-1457.000=171.000
σ0.000
min1628.000-1457.000=171.000
max1628.000-1457.000=171.000
mean2.630-2.628=0.002
σ0.042-0.051=-0.009
min2.593-2.591=0.002
max2.686-2.699=-0.013
policies=200
mean15647.013-15646.954=0.059
σ0.094-0.143=-0.048
min15646.922-15646.769=0.153
max15647.140-15647.087=0.052
mean9200.000
σ0.000
min9200.000
max9200.000
mean1628.000-1457.000=171.000
σ0.000
min1628.000-1457.000=171.000
max1628.000-1457.000=171.000
mean26.339-26.335=0.004
σ0.139-0.129=0.010
min26.200-26.250=-0.050
max26.475-26.528=-0.052