Compare commits

Home / Compare 024ac7cb .. 1c38f968

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.974=-0.175
σ0.108-0.106=0.002
min35.753-35.921=-0.168
max36.105-36.275=-0.170
mean413.000-413.600=-0.600
σ0.000-0.516=-0.516
min413.000
max413.000-414.000=-1.000
mean0.073-0.077=-0.004
σ0.004-0.004=0.001
min0.068-0.075=-0.006
max0.080-0.085=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.065-26.209=-0.143
σ0.002-0.003=-0.001
min26.062-26.203=-0.141
max26.069-26.215=-0.146
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.061-0.061=-0.001
σ0.003-0.003=-0.000
min0.059-0.060=-0.001
max0.068-0.069=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.921-1758.363=-2.442
σ0.370-0.373=-0.003
min1755.352-1757.786=-2.434
max1756.518-1758.959=-2.440
mean1666.200-1646.050=20.150
σ630.062-639.160=-9.097
min665.000-672.000=-7.000
max2621.000-2727.000=-106.000
mean2.819-2.377=0.441
σ0.180-0.089=0.091
min2.290-2.264=0.026
max3.111-2.523=0.588

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.193-279.511=-2.317
σ0.004-0.006=-0.002
min277.190-279.502=-2.312
max277.197-279.517=-2.320
mean2621.000-2727.000=-106.000
σ0.000
min2621.000-2727.000=-106.000
max2621.000-2727.000=-106.000
mean0.396-0.409=-0.013
σ0.004-0.011=-0.007
min0.393-0.402=-0.010
max0.403-0.429=-0.025
iters=5
new-facts=1
prior-facts=6402
mean2174.432-2178.442=-4.009
σ0.012-0.030=-0.018
min2174.415-2178.403=-3.988
max2174.449-2178.473=-4.025
mean2621.000-2727.000=-106.000
σ0.000
min2621.000-2727.000=-106.000
max2621.000-2727.000=-106.000
mean3.050-3.428=-0.378
σ0.225-0.318=-0.093
min2.830-3.203=-0.373
max3.333-3.989=-0.656
iters=5
new-facts=6402
prior-facts=1
mean5052.580-5056.360=-3.780
σ0.970-0.985=-0.016
min5052.020-5055.785=-3.765
max5054.305-5058.111=-3.806
mean2621.000-2727.000=-106.000
σ0.000
min2621.000-2727.000=-106.000
max2621.000-2727.000=-106.000
mean9.005-8.960=0.045
σ0.328-0.562=-0.234
min8.538-8.112=0.426
max9.336-9.483=-0.147
iters=5
new-facts=6402
prior-facts=6402
mean5188.422-5193.749=-5.328
σ0.095-0.093=0.002
min5188.335-5193.669=-5.334
max5188.525-5193.856=-5.331
mean3269.800-3185.400=84.400
σ386.731-442.968=-56.237
min2729.000-2727.000=2.000
max3741.000-3803.000=-62.000
mean9.225-8.776=0.450
σ0.531-0.119=0.412
min8.729-8.659=0.069
max9.795-8.963=0.832

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.307-0.976=0.331
σ0.332-0.051=0.281
min0.940-0.943=-0.003
max1.783-1.066=0.717

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.856-465.478=-0.623
σ572.660-572.658=0.002
min178.520-179.143=-0.623
max1323.846-1324.466=-0.619
mean79.500
σ7.000
min76.000
max90.000
mean2621.000-2727.000=-106.000
σ0.000
min2621.000-2727.000=-106.000
max2621.000-2727.000=-106.000
mean0.549-0.566=-0.017
σ0.534-0.565=-0.031
min0.279-0.278=0.001
max1.350-1.413=-0.063
policies=20
mean1785.488-1791.690=-6.202
σ0.347-0.349=-0.002
min1785.259-1791.473=-6.214
max1786.004-1792.211=-6.208
mean760.000
σ0.000
min760.000
max760.000
mean2621.000-2727.000=-106.000
σ0.000
min2621.000-2727.000=-106.000
max2621.000-2727.000=-106.000
mean2.807-2.791=0.015
σ0.004-0.021=-0.016
min2.801-2.772=0.029
max2.811-2.821=-0.009
policies=200
mean17861.430-17923.526=-62.096
σ0.617-0.466=0.151
min17861.094-17923.260=-62.166
max17862.355-17924.224=-61.869
mean7600.000
σ0.000
min7600.000
max7600.000
mean2621.000-2727.000=-106.000
σ0.000
min2621.000-2727.000=-106.000
max2621.000-2727.000=-106.000
mean28.358-28.139=0.218
σ0.208-0.073=0.135
min28.147-28.048=0.099
max28.636-28.212=0.424