Compare commits

Home / Compare 49be6142 .. 024ac7cb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.974-35.974=-0.000
σ0.106-0.105=0.001
min35.921-35.927=-0.006
max36.275-36.273=0.002
mean413.600-414.000=-0.400
σ0.516-0.000=0.516
min413.000-414.000=-1.000
max414.000
mean0.077-0.077=0.001
σ0.004-0.004=0.000
min0.075-0.071=0.003
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=0.000
σ0.003-0.005=-0.002
min26.203-26.202=0.002
max26.215-26.218=-0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.061-0.061=-0.000
σ0.003-0.002=0.000
min0.060-0.060=-0.000
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.365=-0.002
σ0.373-0.372=0.001
min1757.786-1757.787=-0.001
max1758.959-1758.964=-0.006
mean1646.050-1660.350=-14.300
σ639.160-622.534=16.626
min672.000-688.000=-16.000
max2727.000-2745.000=-18.000
mean2.377-2.412=-0.034
σ0.089-0.119=-0.030
min2.264-2.300=-0.036
max2.523-2.674=-0.150

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.511-279.514=-0.003
σ0.006-0.007=-0.001
min279.502-279.504=-0.002
max279.517-279.520=-0.003
mean2727.000-2745.000=-18.000
σ0.000
min2727.000-2745.000=-18.000
max2727.000-2745.000=-18.000
mean0.409-0.418=-0.010
σ0.011-0.005=0.006
min0.402-0.412=-0.010
max0.429-0.425=0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.442-2178.399=0.043
σ0.030-0.045=-0.015
min2178.403-2178.345=0.058
max2178.473-2178.450=0.023
mean2727.000-2745.000=-18.000
σ0.000
min2727.000-2745.000=-18.000
max2727.000-2745.000=-18.000
mean3.428-3.386=0.042
σ0.318-0.208=0.110
min3.203-3.103=0.100
max3.989-3.650=0.339
iters=5
new-facts=6402
prior-facts=1
mean5056.360-5056.384=-0.025
σ0.985-1.011=-0.026
min5055.785-5055.808=-0.024
max5058.111-5058.181=-0.070
mean2727.000-2745.000=-18.000
σ0.000
min2727.000-2745.000=-18.000
max2727.000-2745.000=-18.000
mean8.960-9.111=-0.151
σ0.562-0.570=-0.008
min8.112-8.375=-0.263
max9.483-9.714=-0.230
iters=5
new-facts=6402
prior-facts=6402
mean5193.749-5193.742=0.007
σ0.093-0.100=-0.006
min5193.669-5193.636=0.033
max5193.856-5193.852=0.003
mean3185.400-3232.800=-47.400
σ442.968-466.038=-23.070
min2727.000-2745.000=-18.000
max3803.000-3873.000=-70.000
mean8.776-8.754=0.021
σ0.119-0.124=-0.005
min8.659-8.676=-0.017
max8.963-8.972=-0.009

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-1.037=-0.061
σ0.051-0.139=-0.087
min0.943-0.942=0.001
max1.066-1.262=-0.195

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.478-465.481=-0.003
σ572.658-572.659=-0.001
min179.143-179.143=0.001
max1324.466-1324.470=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean2727.000-2745.000=-18.000
σ0.000
min2727.000-2745.000=-18.000
max2727.000-2745.000=-18.000
mean0.566-0.497=0.069
σ0.565-0.420=0.145
min0.278-0.284=-0.006
max1.413-1.126=0.287
policies=20
mean1791.690-1791.702=-0.012
σ0.349-0.332=0.017
min1791.473-1791.498=-0.025
max1792.211-1792.195=0.017
mean760.000
σ0.000
min760.000
max760.000
mean2727.000-2745.000=-18.000
σ0.000
min2727.000-2745.000=-18.000
max2727.000-2745.000=-18.000
mean2.791-2.819=-0.028
σ0.021-0.022=-0.002
min2.772-2.793=-0.020
max2.821-2.838=-0.018
policies=200
mean17923.526-17923.417=0.109
σ0.466-0.381=0.085
min17923.260-17923.192=0.067
max17924.224-17923.987=0.237
mean7600.000
σ0.000
min7600.000
max7600.000
mean2727.000-2745.000=-18.000
σ0.000
min2727.000-2745.000=-18.000
max2727.000-2745.000=-18.000
mean28.139-28.328=-0.188
σ0.073-0.119=-0.046
min28.048-28.209=-0.161
max28.212-28.450=-0.238