Compare commits

Home / Compare 1fb18241 .. 701d3a99

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.040-54.038=0.002
σ0.370-0.370=0.001
min53.894-53.897=-0.003
max55.094-55.090=0.003
mean414.000-416.000=-2.000
σ0.000
min414.000-416.000=-2.000
max414.000-416.000=-2.000
mean0.139-0.136=0.003
σ0.003-0.004=-0.000
min0.135-0.131=0.004
max0.146-0.144=0.002
cache=y
dps=1
iters=10
policies=100
mean43.343-43.342=0.001
σ0.006-0.007=-0.001
min43.334-43.333=0.001
max43.357-43.359=-0.002
mean414.600-416.000=-1.400
σ0.516-0.000=0.516
min414.000-416.000=-2.000
max415.000-416.000=-1.000
mean0.125-0.121=0.004
σ0.010-0.004=0.005
min0.115-0.115=-0.000
max0.142-0.128=0.015

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1017.198-1017.203=-0.005
σ1.192-1.173=0.018
min1016.655-1016.632=0.023
max1022.196-1022.112=0.084
mean1052.850-1053.800=-0.950
σ310.326-310.684=-0.358
min562.000
max1510.000-1511.000=-1.000
mean1.559-1.566=-0.007
σ0.054-0.055=-0.001
min1.472-1.502=-0.030
max1.658-1.687=-0.030

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean302.035-302.085=-0.049
σ0.248-0.207=0.041
min301.778-301.868=-0.090
max302.685-302.636=0.049
mean2042.000-2046.000=-4.000
σ0.000
min2042.000-2046.000=-4.000
max2042.000-2046.000=-4.000
mean0.580-0.594=-0.014
σ0.041-0.028=0.013
min0.499-0.521=-0.022
max0.612-0.625=-0.013

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.782-303.774=0.008
σ0.061-0.068=-0.007
min303.684-303.664=0.020
max303.836-303.835=0.002
mean1510.000-1511.000=-1.000
σ0.000
min1510.000-1511.000=-1.000
max1510.000-1511.000=-1.000
mean0.393-0.399=-0.006
σ0.001-0.008=-0.007
min0.392-0.392=-0.000
max0.395-0.409=-0.014
iters=5
new-facts=1
prior-facts=6402
mean1326.328-1326.333=-0.005
σ0.106-0.107=-0.001
min1326.199-1326.200=-0.000
max1326.461-1326.456=0.005
mean1510.000-1511.000=-1.000
σ0.000
min1510.000-1511.000=-1.000
max1510.000-1511.000=-1.000
mean1.928-1.930=-0.002
σ0.146-0.099=0.047
min1.791-1.824=-0.033
max2.130-2.042=0.088
iters=5
new-facts=6402
prior-facts=1
mean1564.375-1564.397=-0.021
σ6.912-6.897=0.015
min1561.081-1561.139=-0.058
max1576.735-1576.731=0.004
mean1510.000-1511.000=-1.000
σ0.000
min1510.000-1511.000=-1.000
max1510.000-1511.000=-1.000
mean2.297-2.309=-0.011
σ0.261-0.270=-0.009
min2.040-2.010=0.030
max2.619-2.627=-0.009
iters=5
new-facts=6402
prior-facts=6402
mean1894.277-1894.279=-0.002
σ0.068-0.070=-0.002
min1894.156-1894.155=0.001
max1894.316-1894.325=-0.009
mean1735.200-1761.800=-26.600
σ217.188-218.992=-1.804
min1510.000-1511.000=-1.000
max2042.000-2046.000=-4.000
mean2.947-3.067=-0.120
σ0.114-0.098=0.016
min2.879-2.978=-0.099
max3.150-3.205=-0.055

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.515-1.512=0.003
σ0.276-0.333=-0.057
min1.217-0.960=0.256
max1.810-1.815=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.051-448.046=0.005
σ581.227-581.227=0.000
min157.432-157.429=0.003
max1319.891-1319.886=0.005
mean96.250
σ8.500
min92.000
max109.000
mean1510.000-1511.000=-1.000
σ0.000
min1510.000-1511.000=-1.000
max1510.000-1511.000=-1.000
mean0.551-0.548=0.004
σ0.563-0.564=-0.002
min0.266-0.263=0.003
max1.396-1.394=0.001
policies=20
mean1574.599-1574.569=0.031
σ0.358-0.349=0.009
min1574.367-1574.336=0.031
max1575.133-1575.088=0.045
mean920.000
σ0.000
min920.000
max920.000
mean1510.000-1511.000=-1.000
σ0.000
min1510.000-1511.000=-1.000
max1510.000-1511.000=-1.000
mean2.649-2.636=0.013
σ0.042-0.015=0.027
min2.611-2.616=-0.006
max2.707-2.654=0.053
policies=200
mean15754.092-15753.982=0.110
σ0.048-0.078=-0.030
min15754.041-15753.929=0.112
max15754.148-15754.094=0.053
mean9200.000
σ0.000
min9200.000
max9200.000
mean1510.000-1511.000=-1.000
σ0.000
min1510.000-1511.000=-1.000
max1510.000-1511.000=-1.000
mean26.849-26.764=0.085
σ0.172-0.089=0.083
min26.716-26.659=0.056
max27.089-26.851=0.238