Compare commits

Home / Compare 78100ed0 .. 36977526

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.951-30.950=0.000
σ0.050-0.050=-0.000
min30.918-30.918=0.000
max31.090-31.090=0.001
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.079-0.074=0.005
σ0.003-0.003=0.000
min0.076-0.070=0.005
max0.086-0.080=0.006
cache=y
dps=1
iters=10
policies=100
mean21.204-21.205=-0.000
σ0.003-0.003=0.000
min21.200-21.200=0.001
max21.209-21.209=-0.000
mean414.000-419.000=-5.000
σ0.000
min414.000-419.000=-5.000
max414.000-419.000=-5.000
mean0.063-0.060=0.003
σ0.002-0.003=-0.001
min0.062-0.057=0.004
max0.069-0.065=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1758.363-1758.379=-0.016
σ0.371-0.367=0.003
min1757.789-1757.805=-0.016
max1758.950-1758.975=-0.025
mean1660.550-1657.500=3.050
σ621.775-630.576=-8.801
min688.000-637.000=51.000
max2744.000-2796.000=-52.000
mean2.362-2.391=-0.028
σ0.099-0.151=-0.052
min2.255-2.250=0.004
max2.546-2.797=-0.251

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean279.508-279.540=-0.033
σ0.005-0.008=-0.003
min279.500-279.527=-0.027
max279.512-279.545=-0.033
mean2744.000-2796.000=-52.000
σ0.000
min2744.000-2796.000=-52.000
max2744.000-2796.000=-52.000
mean0.408-0.404=0.004
σ0.005-0.005=0.000
min0.403-0.400=0.003
max0.416-0.412=0.003
iters=5
new-facts=1
prior-facts=6402
mean2178.442-2178.442=0.000
σ0.009-0.034=-0.026
min2178.428-2178.394=0.034
max2178.449-2178.476=-0.026
mean2744.000-2796.000=-52.000
σ0.000
min2744.000-2796.000=-52.000
max2744.000-2796.000=-52.000
mean3.088-3.535=-0.446
σ0.271-0.326=-0.055
min2.713-3.243=-0.530
max3.443-4.066=-0.622
iters=5
new-facts=6402
prior-facts=1
mean5056.396-5056.299=0.097
σ0.870-1.098=-0.228
min5055.926-5055.252=0.674
max5057.948-5058.167=-0.218
mean2744.000-2796.000=-52.000
σ0.000
min2744.000-2796.000=-52.000
max2744.000-2796.000=-52.000
mean9.076-8.983=0.093
σ0.489-0.721=-0.231
min8.603-8.163=0.440
max9.719-9.849=-0.130
iters=5
new-facts=6402
prior-facts=6402
mean5193.753-5193.721=0.032
σ0.090-0.124=-0.034
min5193.682-5193.538=0.143
max5193.859-5193.886=-0.028
mean3268.600-3304.400=-35.800
σ454.206-408.747=45.459
min2744.000-2796.000=-52.000
max3851.000-3706.000=145.000
mean8.917-8.966=-0.049
σ0.518-0.316=0.202
min8.582-8.671=-0.089
max9.820-9.354=0.466

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.000-0.942=0.058
σ0.076-0.010=0.066
min0.938-0.931=0.007
max1.093-0.957=0.136

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.477-465.539=-0.062
σ572.663-572.662=0.001
min179.139-179.202=-0.063
max1324.471-1324.532=-0.061
mean79.500
σ7.000
min76.000
max90.000
mean2744.000-2796.000=-52.000
σ0.000
min2744.000-2796.000=-52.000
max2744.000-2796.000=-52.000
mean0.468-0.503=-0.036
σ0.373-0.445=-0.072
min0.278-0.280=-0.001
max1.027-1.170=-0.143
policies=20
mean1791.678-1792.281=-0.603
σ0.349-0.344=0.005
min1791.476-1792.085=-0.609
max1792.198-1792.795=-0.597
mean760.000
σ0.000
min760.000
max760.000
mean2744.000-2796.000=-52.000
σ0.000
min2744.000-2796.000=-52.000
max2744.000-2796.000=-52.000
mean2.811-2.799=0.012
σ0.027-0.018=0.009
min2.771-2.776=-0.005
max2.830-2.816=0.014
policies=200
mean17923.471-17929.505=-6.035
σ0.551-0.560=-0.009
min17923.137-17929.064=-5.927
max17924.288-17930.325=-6.037
mean7600.000
σ0.000
min7600.000
max7600.000
mean2744.000-2796.000=-52.000
σ0.000
min2744.000-2796.000=-52.000
max2744.000-2796.000=-52.000
mean28.197-28.164=0.033
σ0.223-0.091=0.133
min27.934-28.059=-0.124
max28.435-28.279=0.156