Compare commits

Home / Compare 5d7e330d .. 08b2bcb0

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.778-70.781=-0.003
σ0.046-0.054=-0.008
min70.748-70.737=0.011
max70.904-70.931=-0.028
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.157-0.155=0.002
σ0.005-0.005=-0.001
min0.149-0.149=0.001
max0.162-0.166=-0.004
cache=y
dps=1
iters=10
policies=100
mean21.491-21.493=-0.002
σ0.002-0.003=-0.001
min21.488-21.489=-0.001
max21.495-21.498=-0.003
mean413.600-413.000=0.600
σ0.843-0.000=0.843
min412.000-413.000=-1.000
max414.000-413.000=1.000
mean0.066-0.066=0.000
σ0.004-0.003=0.001
min0.063-0.064=-0.001
max0.074-0.073=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.095-1751.880=2.215
σ0.359-0.360=-0.000
min1753.535-1751.307=2.228
max1754.669-1752.450=2.219
mean1658.750-1663.550=-4.800
σ635.591-638.591=-3.001
min621.000-676.000=-55.000
max2776.000-2695.000=81.000
mean2.785-2.799=-0.015
σ0.201-0.154=0.047
min2.246-2.382=-0.137
max3.190-3.024=0.166

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.595-269.376=2.218
σ0.011-0.005=0.006
min271.576-269.369=2.207
max271.603-269.383=2.220
mean2776.000-2695.000=81.000
σ0.000
min2776.000-2695.000=81.000
max2776.000-2695.000=81.000
mean0.383-0.377=0.005
σ0.006-0.006=0.000
min0.378-0.374=0.005
max0.393-0.388=0.005
iters=5
new-facts=1
prior-facts=6402
mean1931.993-1929.748=2.245
σ0.019-0.008=0.011
min1931.969-1929.741=2.228
max1932.015-1929.761=2.254
mean2776.000-2695.000=81.000
σ0.000
min2776.000-2695.000=81.000
max2776.000-2695.000=81.000
mean2.512-2.874=-0.363
σ0.086-0.246=-0.160
min2.391-2.511=-0.119
max2.613-3.146=-0.533
iters=5
new-facts=6402
prior-facts=1
mean4752.687-4750.424=2.263
σ0.954-0.926=0.028
min4752.182-4749.711=2.472
max4754.392-4752.046=2.346
mean2776.000-2695.000=81.000
σ0.000
min2776.000-2695.000=81.000
max2776.000-2695.000=81.000
mean8.823-8.314=0.509
σ0.254-0.434=-0.180
min8.450-7.613=0.836
max9.165-8.773=0.393
iters=5
new-facts=6402
prior-facts=6402
mean4943.066-4940.919=2.147
σ0.312-0.138=0.174
min4942.509-4940.674=1.835
max4943.222-4940.997=2.226
mean3017.400-2968.400=49.000
σ233.515-327.440=-93.925
min2776.000-2695.000=81.000
max3322.000-3465.000=-143.000
mean8.547-8.439=0.108
σ0.140-0.129=0.011
min8.397-8.290=0.106
max8.763-8.633=0.130

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.024-1.097=-0.074
σ0.146-0.178=-0.032
min0.930-0.932=-0.002
max1.265-1.321=-0.056

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.641-462.699=5.943
σ574.924-574.940=-0.016
min181.168-175.225=5.944
max1331.027-1325.109=5.918
mean88.250-86.250=2.000
σ8.500
min84.000-82.000=2.000
max101.000-99.000=2.000
mean2776.000-2695.000=81.000
σ0.000
min2776.000-2695.000=81.000
max2776.000-2695.000=81.000
mean0.448-0.548=-0.100
σ0.304-0.537=-0.232
min0.292-0.274=0.018
max0.905-1.353=-0.449
policies=20
mean1812.015-1752.504=59.512
σ0.371-0.365=0.006
min1811.730-1752.269=59.462
max1812.543-1753.048=59.494
mean840.000-820.000=20.000
σ0.000
min840.000-820.000=20.000
max840.000-820.000=20.000
mean2776.000-2695.000=81.000
σ0.000
min2776.000-2695.000=81.000
max2776.000-2695.000=81.000
mean2.932-2.748=0.185
σ0.098-0.009=0.088
min2.834-2.736=0.098
max3.067-2.757=0.310
policies=200
mean18126.815-17532.146=594.669
σ0.556-0.419=0.137
min18126.467-17531.925=594.542
max18127.645-17532.774=594.871
mean8400.000-8200.000=200.000
σ0.000
min8400.000-8200.000=200.000
max8400.000-8200.000=200.000
mean2776.000-2695.000=81.000
σ0.000
min2776.000-2695.000=81.000
max2776.000-2695.000=81.000
mean28.644-27.602=1.042
σ0.235-0.140=0.094
min28.515-27.489=1.026
max28.996-27.802=1.194