Compare commits

Home / Compare 8ad29c22 .. d226ce20

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.823-53.824=-0.000
σ0.367-0.368=-0.001
min53.674-53.674=0.000
max54.868-54.870=-0.002
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.138-0.137=0.000
σ0.004-0.004=0.000
min0.131-0.132=-0.001
max0.144-0.143=0.001
cache=y
dps=1
iters=10
policies=100
mean43.208-43.207=0.001
σ0.006-0.006=0.000
min43.201-43.198=0.003
max43.217-43.217=0.000
mean416.000-418.000=-2.000
σ0.000
min416.000-418.000=-2.000
max416.000-418.000=-2.000
mean0.122-0.120=0.002
σ0.004-0.004=-0.000
min0.118-0.115=0.003
max0.126-0.127=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.177-1016.178=-0.000
σ1.149-1.169=-0.020
min1015.612-1015.601=0.012
max1020.982-1021.073=-0.091
mean1042.900-1046.700=-3.800
σ310.391-292.725=17.666
min597.000-580.000=17.000
max1633.000-1432.000=201.000
mean1.543-1.548=-0.004
σ0.077-0.075=0.002
min1.460-1.488=-0.028
max1.790-1.750=0.040

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.088-301.329=-0.241
σ0.241-0.223=0.018
min300.854-301.169=-0.315
max301.602-301.925=-0.324
mean2029.000-1934.000=95.000
σ0.000
min2029.000-1934.000=95.000
max2029.000-1934.000=95.000
mean0.560-0.538=0.022
σ0.038-0.032=0.006
min0.499-0.497=0.002
max0.599-0.587=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean300.700-300.706=-0.006
σ0.024-0.011=0.013
min300.672-300.695=-0.023
max300.734-300.724=0.010
mean1633.000-1432.000=201.000
σ0.000
min1633.000-1432.000=201.000
max1633.000-1432.000=201.000
mean0.399-0.397=0.001
σ0.011-0.007=0.004
min0.388-0.390=-0.001
max0.415-0.403=0.012
iters=5
new-facts=1
prior-facts=6402
mean1322.861-1322.888=-0.028
σ0.099-0.062=0.036
min1322.810-1322.816=-0.005
max1323.037-1322.956=0.082
mean1633.000-1432.000=201.000
σ0.000
min1633.000-1432.000=201.000
max1633.000-1432.000=201.000
mean1.891-2.097=-0.205
σ0.089-0.221=-0.131
min1.814-1.881=-0.067
max2.024-2.387=-0.364
iters=5
new-facts=6402
prior-facts=1
mean1561.298-1561.360=-0.062
σ6.878-6.860=0.018
min1557.968-1558.106=-0.138
max1573.596-1573.629=-0.034
mean1633.000-1432.000=201.000
σ0.000
min1633.000-1432.000=201.000
max1633.000-1432.000=201.000
mean2.226-2.295=-0.069
σ0.226-0.249=-0.024
min2.076-2.061=0.015
max2.625-2.703=-0.078
iters=5
new-facts=6402
prior-facts=6402
mean1890.787-1890.801=-0.014
σ0.016-0.027=-0.010
min1890.766-1890.781=-0.015
max1890.812-1890.848=-0.036
mean1770.400-1750.400=20.000
σ169.132-142.642=26.490
min1633.000-1539.000=94.000
max2029.000-1934.000=95.000
mean2.925-2.934=-0.009
σ0.110-0.219=-0.109
min2.853-2.719=0.134
max3.119-3.249=-0.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.203-1.639=-0.436
σ0.341-0.105=0.236
min0.916-1.502=-0.587
max1.780-1.762=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.337-443.327=0.010
σ573.989-573.978=0.011
min156.334-156.335=-0.000
max1304.321-1304.294=0.027
mean96.250
σ8.500
min92.000
max109.000
mean1633.000-1432.000=201.000
σ0.000
min1633.000-1432.000=201.000
max1633.000-1432.000=201.000
mean0.526-0.520=0.006
σ0.536-0.520=0.016
min0.257-0.256=0.000
max1.330-1.300=0.029
policies=20
mean1563.631-1563.617=0.014
σ0.324-0.331=-0.007
min1563.451-1563.396=0.055
max1564.116-1564.110=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1633.000-1432.000=201.000
σ0.000
min1633.000-1432.000=201.000
max1633.000-1432.000=201.000
mean2.606-2.603=0.003
σ0.026-0.011=0.015
min2.573-2.591=-0.018
max2.635-2.617=0.017
policies=200
mean15644.076-15644.107=-0.031
σ0.061-0.143=-0.082
min15643.987-15643.926=0.061
max15644.123-15644.252=-0.129
mean9200.000
σ0.000
min9200.000
max9200.000
mean1633.000-1432.000=201.000
σ0.000
min1633.000-1432.000=201.000
max1633.000-1432.000=201.000
mean26.391-26.481=-0.090
σ0.215-0.193=0.023
min26.181-26.322=-0.141
max26.643-26.737=-0.093