Compare commits

Home / Compare 4da8fc2d .. c31e570b

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.964=0.010
σ0.107-0.105=0.002
min35.928-35.919=0.009
max36.278-36.263=0.015
mean413.000-411.000=2.000
σ0.000
min413.000-411.000=2.000
max413.000-411.000=2.000
mean0.076-0.078=-0.002
σ0.005-0.004=0.001
min0.070-0.075=-0.005
max0.085-0.087=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.208-26.201=0.007
σ0.003-0.003=0.001
min26.203-26.196=0.007
max26.214-26.205=0.009
mean413.000-411.600=1.400
σ0.000-0.516=-0.516
min413.000-411.000=2.000
max413.000-412.000=1.000
mean0.061-0.061=-0.000
σ0.003-0.004=-0.001
min0.059-0.058=0.001
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.364-1758.266=0.098
σ0.372-0.371=0.000
min1757.787-1757.689=0.097
max1758.963-1758.860=0.103
mean1657.400-1653.300=4.100
σ624.196-620.365=3.831
min686.000-685.000=1.000
max2766.000-2740.000=26.000
mean2.371-2.364=0.008
σ0.112-0.112=0.001
min2.227-2.183=0.044
max2.608-2.584=0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.509-279.317=0.192
σ0.004-0.012=-0.007
min279.502-279.304=0.198
max279.513-279.333=0.180
mean2766.000-2740.000=26.000
σ0.000
min2766.000-2740.000=26.000
max2766.000-2740.000=26.000
mean0.409-0.418=-0.009
σ0.001-0.012=-0.011
min0.407-0.404=0.003
max0.410-0.433=-0.022
iters=5
new-facts=1
prior-facts=6402
mean2178.436-2178.263=0.173
σ0.009-0.012=-0.003
min2178.422-2178.250=0.172
max2178.444-2178.274=0.170
mean2766.000-2740.000=26.000
σ0.000
min2766.000-2740.000=26.000
max2766.000-2740.000=26.000
mean3.259-3.360=-0.101
σ0.260-0.188=0.072
min2.830-3.176=-0.346
max3.507-3.676=-0.169
iters=5
new-facts=6402
prior-facts=1
mean5056.375-5047.938=8.438
σ0.984-0.996=-0.012
min5055.797-5047.321=8.475
max5058.126-5049.706=8.420
mean2766.000-2740.000=26.000
σ0.000
min2766.000-2740.000=26.000
max2766.000-2740.000=26.000
mean8.695-8.786=-0.090
σ0.557-0.628=-0.070
min8.150-8.108=0.042
max9.534-9.613=-0.079
iters=5
new-facts=6402
prior-facts=6402
mean5193.681-5185.307=8.375
σ0.126-0.091=0.035
min5193.503-5185.237=8.266
max5193.855-5185.411=8.444
mean3238.400-3221.600=16.800
σ331.760-469.708=-137.948
min2766.000-2740.000=26.000
max3673.000-3873.000=-200.000
mean9.107-8.721=0.386
σ0.516-0.161=0.355
min8.698-8.566=0.132
max9.709-8.988=0.721

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.975-1.003=-0.028
σ0.056-0.129=-0.074
min0.939-0.941=-0.002
max1.070-1.234=-0.164

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.471-465.358=0.113
σ572.662-572.654=0.008
min179.139-179.008=0.131
max1324.464-1324.339=0.126
mean79.500
σ7.000
min76.000
max90.000
mean2766.000-2740.000=26.000
σ0.000
min2766.000-2740.000=26.000
max2766.000-2740.000=26.000
mean0.469-0.498=-0.029
σ0.391-0.422=-0.031
min0.265-0.284=-0.019
max1.056-1.131=-0.075
policies=20
mean1791.673-1790.334=1.339
σ0.317-0.317=-0.000
min1791.478-1790.117=1.361
max1792.144-1790.805=1.339
mean760.000
σ0.000
min760.000
max760.000
mean2766.000-2740.000=26.000
σ0.000
min2766.000-2740.000=26.000
max2766.000-2740.000=26.000
mean2.790-2.798=-0.008
σ0.015-0.023=-0.007
min2.775-2.781=-0.006
max2.811-2.831=-0.020
policies=200
mean17923.239-17909.965=13.274
σ0.527-0.581=-0.054
min17922.943-17909.577=13.366
max17924.027-17910.825=13.203
mean7600.000
σ0.000
min7600.000
max7600.000
mean2766.000-2740.000=26.000
σ0.000
min2766.000-2740.000=26.000
max2766.000-2740.000=26.000
mean28.357-28.283=0.074
σ0.047-0.121=-0.073
min28.290-28.119=0.171
max28.400-28.396=0.004