Compare commits

Home / Compare a7c9cda9 .. 8ce0ae6f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-35.974=-5.201
σ0.046-0.105=-0.059
min30.754-35.927=-5.173
max30.905-36.273=-5.369
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.077-0.077=0.001
σ0.003-0.004=-0.000
min0.071-0.071=-0.000
max0.085-0.084=0.001
cache=y
dps=1
iters=10
policies=100
mean21.059-26.209=-5.150
σ0.003-0.005=-0.002
min21.054-26.202=-5.147
max21.063-26.218=-5.155
mean411.000-414.000=-3.000
σ0.000
min411.000-414.000=-3.000
max411.000-414.000=-3.000
mean0.064-0.061=0.002
σ0.002-0.002=-0.000
min0.062-0.060=0.002
max0.069-0.068=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1758.365=-7.129
σ0.363-0.372=-0.010
min1750.671-1757.787=-7.116
max1751.815-1758.964=-7.150
mean1651.650-1660.350=-8.700
σ645.486-622.534=22.952
min648.000-688.000=-40.000
max2843.000-2745.000=98.000
mean2.805-2.412=0.393
σ0.204-0.119=0.086
min2.361-2.300=0.061
max3.233-2.674=0.560

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.565-279.514=-3.949
σ0.006-0.007=-0.001
min275.559-279.504=-3.945
max275.573-279.520=-3.947
mean2843.000-2745.000=98.000
σ0.000
min2843.000-2745.000=98.000
max2843.000-2745.000=98.000
mean0.387-0.418=-0.032
σ0.002-0.005=-0.004
min0.384-0.412=-0.028
max0.389-0.425=-0.037
iters=5
new-facts=1
prior-facts=6402
mean2168.090-2178.399=-10.309
σ0.022-0.045=-0.023
min2168.059-2178.345=-10.286
max2168.117-2178.450=-10.333
mean2843.000-2745.000=98.000
σ0.000
min2843.000-2745.000=98.000
max2843.000-2745.000=98.000
mean2.844-3.386=-0.542
σ0.129-0.208=-0.079
min2.673-3.103=-0.430
max2.995-3.650=-0.656
iters=5
new-facts=6402
prior-facts=1
mean5047.949-5056.384=-8.435
σ0.923-1.011=-0.089
min5047.372-5055.808=-8.436
max5049.590-5058.181=-8.591
mean2843.000-2745.000=98.000
σ0.000
min2843.000-2745.000=98.000
max2843.000-2745.000=98.000
mean8.872-9.111=-0.239
σ0.641-0.570=0.071
min8.091-8.375=-0.284
max9.533-9.714=-0.180
iters=5
new-facts=6402
prior-facts=6402
mean5179.048-5193.742=-14.695
σ0.095-0.100=-0.004
min5178.958-5193.636=-14.678
max5179.154-5193.852=-14.699
mean3283.000-3232.800=50.200
σ392.859-466.038=-73.178
min2843.000-2745.000=98.000
max3848.000-3873.000=-25.000
mean9.712-8.754=0.958
σ0.588-0.124=0.464
min8.795-8.676=0.119
max10.177-8.972=1.205

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.098-1.037=0.061
σ0.217-0.139=0.078
min0.972-0.942=0.030
max1.475-1.262=0.213

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-465.481=-2.279
σ572.650-572.659=-0.009
min176.870-179.143=-2.273
max1322.178-1324.470=-2.292
mean77.500-79.500=-2.000
σ7.000
min74.000-76.000=-2.000
max88.000-90.000=-2.000
mean2843.000-2745.000=98.000
σ0.000
min2843.000-2745.000=98.000
max2843.000-2745.000=98.000
mean0.439-0.497=-0.058
σ0.313-0.420=-0.107
min0.275-0.284=-0.009
max0.908-1.126=-0.218
policies=20
mean1768.973-1791.702=-22.729
σ0.346-0.332=0.014
min1768.734-1791.498=-22.764
max1769.484-1792.195=-22.711
mean740.000-760.000=-20.000
σ0.000
min740.000-760.000=-20.000
max740.000-760.000=-20.000
mean2843.000-2745.000=98.000
σ0.000
min2843.000-2745.000=98.000
max2843.000-2745.000=98.000
mean2.850-2.819=0.032
σ0.017-0.022=-0.005
min2.829-2.793=0.036
max2.871-2.838=0.032
policies=200
mean17696.042-17923.417=-227.374
σ0.488-0.381=0.106
min17695.732-17923.192=-227.460
max17696.765-17923.987=-227.223
mean7400.000-7600.000=-200.000
σ0.000
min7400.000-7600.000=-200.000
max7400.000-7600.000=-200.000
mean2843.000-2745.000=98.000
σ0.000
min2843.000-2745.000=98.000
max2843.000-2745.000=98.000
mean28.156-28.328=-0.172
σ0.531-0.119=0.411
min27.502-28.209=-0.707
max28.646-28.450=0.196