Compare commits

Home / Compare 32cdcd14 .. 3691ff9c

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.946-53.946=-0.000
σ0.368-0.368=0.000
min53.804-53.803=0.001
max54.994-54.993=0.001
mean414.700-416.000=-1.300
σ0.483-0.000=0.483
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.140-0.138=0.001
σ0.004-0.005=-0.001
min0.136-0.133=0.003
max0.146-0.149=-0.003
cache=y
dps=1
iters=10
policies=100
mean43.322-43.322=0.000
σ0.007-0.006=0.001
min43.310-43.313=-0.003
max43.335-43.334=0.001
mean415.000-416.000=-1.000
σ0.000
min415.000-416.000=-1.000
max415.000-416.000=-1.000
mean0.121-0.122=-0.001
σ0.001-0.004=-0.003
min0.119-0.115=0.005
max0.123-0.127=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1010.700-1010.697=0.003
σ1.157-1.166=-0.010
min1010.127-1010.126=0.001
max1015.536-1015.582=-0.046
mean1040.700-1042.900=-2.200
σ295.188-296.772=-1.584
min570.000
max1439.000-1445.000=-6.000
mean1.492-1.516=-0.025
σ0.072-0.068=0.004
min1.401-1.435=-0.034
max1.675-1.688=-0.013

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean300.898-300.788=0.110
σ0.235-0.227=0.007
min300.668-300.609=0.060
max301.535-301.390=0.145
mean2021.000-1933.000=88.000
σ0.000
min2021.000-1933.000=88.000
max2021.000-1933.000=88.000
mean0.533-0.587=-0.054
σ0.027-0.046=-0.019
min0.504-0.522=-0.018
max0.574-0.701=-0.128

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean299.185-299.179=0.006
σ0.030-0.043=-0.014
min299.146-299.110=0.037
max299.222-299.218=0.004
mean1439.000-1445.000=-6.000
σ0.000
min1439.000-1445.000=-6.000
max1439.000-1445.000=-6.000
mean0.385-0.387=-0.002
σ0.002-0.007=-0.005
min0.381-0.383=-0.002
max0.387-0.400=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1309.611-1309.613=-0.001
σ0.110-0.098=0.012
min1309.463-1309.491=-0.029
max1309.747-1309.736=0.011
mean1439.000-1445.000=-6.000
σ0.000
min1439.000-1445.000=-6.000
max1439.000-1445.000=-6.000
mean1.996-1.909=0.087
σ0.289-0.085=0.204
min1.755-1.820=-0.065
max2.369-2.008=0.361
iters=5
new-facts=6402
prior-facts=1
mean1553.782-1553.694=0.088
σ6.860-6.884=-0.025
min1550.544-1550.342=0.202
max1566.051-1566.004=0.047
mean1439.000-1445.000=-6.000
σ0.000
min1439.000-1445.000=-6.000
max1439.000-1445.000=-6.000
mean2.387-2.239=0.148
σ0.288-0.248=0.040
min2.091-2.107=-0.016
max2.835-2.679=0.156
iters=5
new-facts=6402
prior-facts=6402
mean1871.501-1871.500=0.001
σ0.064-0.055=0.008
min1871.429-1871.436=-0.007
max1871.572-1871.542=0.030
mean1720.600-1736.600=-16.000
σ203.398-210.322=-6.924
min1543.000-1451.000=92.000
max2021.000-1933.000=88.000
mean2.872-2.908=-0.036
σ0.040-0.106=-0.066
min2.824-2.807=0.017
max2.919-3.074=-0.156

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.676-1.757=-0.081
σ0.034-0.039=-0.005
min1.639-1.694=-0.055
max1.731-1.796=-0.066

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.444-444.440=0.004
σ575.131-575.124=0.007
min156.875-156.874=0.002
max1307.140-1307.125=0.015
mean96.250
σ8.500
min92.000
max109.000
mean1439.000-1445.000=-6.000
σ0.000
min1439.000-1445.000=-6.000
max1439.000-1445.000=-6.000
mean0.551-0.530=0.021
σ0.575-0.533=0.042
min0.259-0.258=0.001
max1.414-1.329=0.085
policies=20
mean1569.012-1569.024=-0.012
σ0.328-0.344=-0.016
min1568.801-1568.813=-0.012
max1569.501-1569.538=-0.037
mean920.000
σ0.000
min920.000
max920.000
mean1439.000-1445.000=-6.000
σ0.000
min1439.000-1445.000=-6.000
max1439.000-1445.000=-6.000
mean2.608-2.624=-0.016
σ0.005-0.017=-0.012
min2.604-2.610=-0.005
max2.615-2.648=-0.032
policies=200
mean15698.083-15698.088=-0.005
σ0.157-0.105=0.051
min15697.926-15698.015=-0.088
max15698.297-15698.244=0.053
mean9200.000
σ0.000
min9200.000
max9200.000
mean1439.000-1445.000=-6.000
σ0.000
min1439.000-1445.000=-6.000
max1439.000-1445.000=-6.000
mean26.377-26.325=0.053
σ0.160-0.113=0.047
min26.201-26.208=-0.006
max26.536-26.474=0.062