Compare commits

Home / Compare 33a9d978 .. 69085b70

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.389=0.392
σ0.048-0.048=0.000
min70.745-70.359=0.387
max70.913-70.522=0.391
mean416.000
σ0.000
min416.000
max416.000
mean0.162-0.160=0.002
σ0.003-0.003=-0.000
min0.158-0.157=0.001
max0.166-0.166=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.143=0.349
σ0.002-0.003=-0.001
min21.489-21.138=0.351
max21.496-21.149=0.347
mean416.000
σ0.000
min416.000
max416.000
mean0.065-0.064=0.002
σ0.003-0.002=0.000
min0.063-0.062=0.001
max0.073-0.070=0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1752.395=1.701
σ0.361-0.361=-0.000
min1753.530-1751.828=1.702
max1754.684-1752.983=1.701
mean1660.250-1652.000=8.250
σ632.632-638.734=-6.103
min630.000-620.000=10.000
max2714.000-2773.000=-59.000
mean2.845-2.838=0.008
σ0.215-0.108=0.107
min2.312-2.651=-0.339
max3.370-3.105=0.265

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.955-270.142=1.813
σ0.007-0.007=0.000
min271.945-270.133=1.812
max271.964-270.150=1.814
mean2714.000-2773.000=-59.000
σ0.000
min2714.000-2773.000=-59.000
max2714.000-2773.000=-59.000
mean0.382-0.378=0.004
σ0.001-0.003=-0.001
min0.380-0.374=0.007
max0.383-0.381=0.003
iters=5
new-facts=1
prior-facts=6402
mean1932.319-1930.597=1.722
σ0.007-0.013=-0.006
min1932.310-1930.583=1.727
max1932.329-1930.617=1.712
mean2714.000-2773.000=-59.000
σ0.000
min2714.000-2773.000=-59.000
max2714.000-2773.000=-59.000
mean3.072-2.576=0.496
σ0.086-0.095=-0.008
min2.979-2.498=0.482
max3.168-2.733=0.435
iters=5
new-facts=6402
prior-facts=1
mean4753.117-4751.199=1.918
σ0.890-1.005=-0.116
min4752.593-4750.326=2.267
max4754.697-4752.931=1.767
mean2714.000-2773.000=-59.000
σ0.000
min2714.000-2773.000=-59.000
max2714.000-2773.000=-59.000
mean8.465-8.509=-0.044
σ0.507-0.529=-0.022
min7.710-7.617=0.093
max8.959-8.976=-0.017
iters=5
new-facts=6402
prior-facts=6402
mean4943.559-4941.778=1.781
σ0.012-0.017=-0.005
min4943.540-4941.756=1.784
max4943.571-4941.801=1.770
mean3020.400-3026.800=-6.400
σ250.302-262.066=-11.764
min2714.000-2773.000=-59.000
max3337.000-3296.000=41.000
mean8.517-8.656=-0.139
σ0.151-0.263=-0.112
min8.350-8.235=0.115
max8.720-8.953=-0.233

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.026-1.053=-0.027
σ0.139-0.131=0.007
min0.933-0.936=-0.003
max1.252-1.259=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-466.375=2.291
σ574.937-575.927=-0.989
min181.189-178.409=2.780
max1331.072-1330.265=0.807
mean88.250-84.250=4.000
σ8.500
min84.000-80.000=4.000
max101.000-97.000=4.000
mean2714.000-2773.000=-59.000
σ0.000
min2714.000-2773.000=-59.000
max2714.000-2773.000=-59.000
mean0.583-0.443=0.140
σ0.589-0.305=0.284
min0.286-0.289=-0.003
max1.466-0.900=0.566
policies=20
mean1812.200-1784.368=27.833
σ0.402-0.377=0.025
min1811.925-1784.111=27.814
max1812.793-1784.922=27.871
mean840.000-800.000=40.000
σ0.000
min840.000-800.000=40.000
max840.000-800.000=40.000
mean2714.000-2773.000=-59.000
σ0.000
min2714.000-2773.000=-59.000
max2714.000-2773.000=-59.000
mean2.851-2.810=0.042
σ0.019-0.045=-0.026
min2.833-2.770=0.064
max2.874-2.852=0.021
policies=200
mean18129.229-17849.710=279.519
σ0.489-0.520=-0.031
min18128.893-17849.270=279.622
max18129.955-17850.453=279.502
mean8400.000-8000.000=400.000
σ0.000
min8400.000-8000.000=400.000
max8400.000-8000.000=400.000
mean2714.000-2773.000=-59.000
σ0.000
min2714.000-2773.000=-59.000
max2714.000-2773.000=-59.000
mean28.602-28.031=0.571
σ0.058-0.092=-0.035
min28.538-27.920=0.618
max28.665-28.119=0.546