Compare commits

Home / Compare 564c44f8 .. 7ce48700

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.375-31.038=39.337
σ0.059-0.048=0.011
min70.337-30.999=39.338
max70.538-31.171=39.367
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.160-0.077=0.083
σ0.003-0.004=-0.001
min0.156-0.072=0.085
max0.164-0.085=0.079
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.001
σ0.002-0.002=0.001
min21.140-21.140=0.000
max21.148-21.145=0.003
mean415.000-410.000=5.000
σ0.000
min415.000-410.000=5.000
max415.000-410.000=5.000
mean0.062-0.065=-0.003
σ0.004-0.003=0.001
min0.058-0.062=-0.005
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1751.412=0.787
σ0.361-0.362=-0.001
min1751.624-1750.842=0.782
max1752.775-1751.992=0.783
mean1654.950-1663.800=-8.850
σ648.208-629.348=18.860
min646.000-633.000=13.000
max2861.000-2520.000=341.000
mean2.843-2.826=0.017
σ0.086-0.162=-0.076
min2.704-2.348=0.355
max3.033-3.042=-0.008

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.931-273.406=-3.475
σ0.009-0.011=-0.002
min269.919-273.391=-3.472
max269.942-273.418=-3.476
mean2861.000-2520.000=341.000
σ0.000
min2861.000-2520.000=341.000
max2861.000-2520.000=341.000
mean0.380-0.391=-0.011
σ0.009-0.009=-0.001
min0.372-0.379=-0.007
max0.394-0.401=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1930.397-1933.844=-3.447
σ0.013-0.014=-0.001
min1930.388-1933.830=-3.442
max1930.418-1933.862=-3.444
mean2861.000-2520.000=341.000
σ0.000
min2861.000-2520.000=341.000
max2861.000-2520.000=341.000
mean2.552-3.182=-0.629
σ0.132-0.287=-0.156
min2.457-3.008=-0.551
max2.767-3.685=-0.918
iters=5
new-facts=6402
prior-facts=1
mean4750.753-4754.409=-3.656
σ0.605-0.781=-0.176
min4750.301-4754.014=-3.713
max4751.818-4755.802=-3.985
mean2861.000-2520.000=341.000
σ0.000
min2861.000-2520.000=341.000
max2861.000-2520.000=341.000
mean8.545-8.033=0.512
σ0.542-0.298=0.243
min7.649-7.799=-0.150
max9.037-8.544=0.493
iters=5
new-facts=6402
prior-facts=6402
mean4941.118-4944.799=-3.681
σ0.297-0.078=0.218
min4940.723-4944.733=-4.009
max4941.426-4944.891=-3.465
mean3058.400-2935.000=123.400
σ194.692-387.531=-192.840
min2861.000-2520.000=341.000
max3343.000-3479.000=-136.000
mean8.560-8.498=0.062
σ0.229-0.155=0.075
min8.361-8.334=0.027
max8.914-8.703=0.211

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.047-1.652=-0.605
σ0.128-0.187=-0.059
min0.933-1.388=-0.455
max1.244-1.850=-0.606

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.909-463.333=2.576
σ575.757-572.198=3.559
min178.027-177.234=0.793
max1329.544-1321.630=7.914
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2861.000-2520.000=341.000
σ0.000
min2861.000-2520.000=341.000
max2861.000-2520.000=341.000
mean0.443-0.562=-0.119
σ0.304-0.557=-0.253
min0.289-0.276=0.013
max0.899-1.398=-0.499
policies=20
mean1780.474-1772.571=7.903
σ0.349-0.334=0.015
min1780.229-1772.347=7.882
max1780.986-1773.067=7.919
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2861.000-2520.000=341.000
σ0.000
min2861.000-2520.000=341.000
max2861.000-2520.000=341.000
mean2.847-2.742=0.105
σ0.006-0.007=-0.002
min2.843-2.734=0.109
max2.855-2.752=0.103
policies=200
mean17811.246-17732.393=78.853
σ0.417-0.420=-0.003
min17810.875-17732.088=78.787
max17811.834-17733.001=78.833
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2861.000-2520.000=341.000
σ0.000
min2861.000-2520.000=341.000
max2861.000-2520.000=341.000
mean28.359-27.658=0.700
σ0.515-0.091=0.424
min27.849-27.602=0.247
max28.877-27.794=1.083