Compare commits

Home / Compare ea3f017c .. c0c11bac

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.975-35.974=0.001
σ0.107-0.107=-0.000
min35.929-35.923=0.006
max36.279-36.278=0.000
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.078-0.075=0.003
σ0.003-0.003=0.000
min0.076-0.071=0.005
max0.085-0.080=0.004
cache=y
dps=1
iters=10
policies=100
mean26.208-26.209=-0.000
σ0.004-0.003=0.001
min26.204-26.204=-0.000
max26.215-26.212=0.003
mean414.000-413.000=1.000
σ0.000
min414.000-413.000=1.000
max414.000-413.000=1.000
mean0.062-0.060=0.002
σ0.003-0.003=0.000
min0.059-0.057=0.002
max0.069-0.067=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.365=-0.002
σ0.372-0.370=0.002
min1757.786-1757.786=-0.000
max1758.948-1758.959=-0.011
mean1644.150-1657.500=-13.350
σ624.136-619.814=4.322
min672.000-687.000=-15.000
max2772.000-2747.000=25.000
mean2.360-2.412=-0.052
σ0.089-0.158=-0.069
min2.191-2.246=-0.056
max2.490-2.888=-0.398

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.514-279.510=0.004
σ0.008-0.005=0.003
min279.504-279.504=-0.000
max279.522-279.518=0.004
mean2772.000-2747.000=25.000
σ0.000
min2772.000-2747.000=25.000
max2772.000-2747.000=25.000
mean0.414-0.409=0.005
σ0.003-0.005=-0.003
min0.410-0.406=0.004
max0.417-0.418=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2178.432-2178.433=-0.001
σ0.017-0.014=0.002
min2178.413-2178.410=0.003
max2178.453-2178.448=0.006
mean2772.000-2747.000=25.000
σ0.000
min2772.000-2747.000=25.000
max2772.000-2747.000=25.000
mean3.338-3.318=0.020
σ0.229-0.143=0.086
min2.967-3.192=-0.224
max3.566-3.560=0.006
iters=5
new-facts=6402
prior-facts=1
mean5056.346-5056.271=0.075
σ0.994-1.135=-0.141
min5055.762-5055.307=0.455
max5058.113-5058.233=-0.119
mean2772.000-2747.000=25.000
σ0.000
min2772.000-2747.000=25.000
max2772.000-2747.000=25.000
mean9.051-9.007=0.044
σ0.488-0.723=-0.236
min8.231-8.140=0.091
max9.533-9.987=-0.454
iters=5
new-facts=6402
prior-facts=6402
mean5193.762-5193.687=0.074
σ0.089-0.210=-0.121
min5193.692-5193.339=0.353
max5193.863-5193.863=-0.000
mean3309.800-3182.400=127.400
σ375.474-368.724=6.750
min2772.000-2797.000=-25.000
max3645.000-3744.000=-99.000
mean8.993-8.788=0.205
σ0.224-0.136=0.088
min8.731-8.646=0.085
max9.323-8.967=0.356

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.090-0.975=0.115
σ0.259-0.054=0.205
min0.938-0.940=-0.002
max1.541-1.070=0.471

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.487-465.471=0.016
σ572.689-572.656=0.034
min179.140-179.140=0.000
max1324.521-1324.455=0.066
mean79.500
σ7.000
min76.000
max90.000
mean2772.000-2747.000=25.000
σ0.000
min2772.000-2747.000=25.000
max2772.000-2747.000=25.000
mean0.531-0.481=0.050
σ0.493-0.400=0.093
min0.280-0.279=0.001
max1.270-1.082=0.189
policies=20
mean1791.683-1791.671=0.012
σ0.349-0.340=0.009
min1791.444-1791.470=-0.025
max1792.201-1792.178=0.023
mean760.000
σ0.000
min760.000
max760.000
mean2772.000-2747.000=25.000
σ0.000
min2772.000-2747.000=25.000
max2772.000-2747.000=25.000
mean2.803-2.814=-0.011
σ0.012-0.008=0.003
min2.791-2.806=-0.015
max2.819-2.825=-0.006
policies=200
mean17923.490-17923.399=0.091
σ0.543-0.574=-0.031
min17923.194-17923.026=0.168
max17924.304-17924.245=0.059
mean7600.000
σ0.000
min7600.000
max7600.000
mean2772.000-2747.000=25.000
σ0.000
min2772.000-2747.000=25.000
max2772.000-2747.000=25.000
mean28.242-28.363=-0.121
σ0.144-0.166=-0.023
min28.074-28.150=-0.075
max28.401-28.554=-0.154