Compare commits

Home / Compare b5c63cd3 .. c7747961

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.799-35.973=-0.174
σ0.106-0.107=-0.001
min35.752-35.923=-0.171
max36.099-36.275=-0.176
mean412.900-412.000=0.900
σ0.316-0.000=0.316
min412.000
max413.000-412.000=1.000
mean0.076-0.075=0.000
σ0.004-0.004=-0.001
min0.073-0.071=0.002
max0.083-0.083=0.001
cache=y
dps=1
iters=10
policies=100
mean26.065-26.209=-0.144
σ0.003-0.004=-0.001
min26.059-26.203=-0.144
max26.068-26.216=-0.148
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.061-0.061=-0.000
σ0.003-0.003=-0.000
min0.059-0.058=0.001
max0.068-0.069=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1755.922-1758.378=-2.457
σ0.367-0.373=-0.006
min1755.350-1757.802=-2.453
max1756.520-1758.988=-2.467
mean1671.650-1640.000=31.650
σ631.637-605.723=25.914
min667.000-678.000=-11.000
max2630.000-2554.000=76.000
mean2.803-2.370=0.433
σ0.207-0.142=0.065
min2.348-2.244=0.104
max3.092-2.883=0.209

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean277.196-279.558=-2.362
σ0.004-0.008=-0.004
min277.193-279.547=-2.354
max277.201-279.567=-2.366
mean2630.000-2554.000=76.000
σ0.000
min2630.000-2554.000=76.000
max2630.000-2554.000=76.000
mean0.395-0.410=-0.016
σ0.001-0.006=-0.005
min0.393-0.405=-0.012
max0.396-0.420=-0.024
iters=5
new-facts=1
prior-facts=6402
mean2174.424-2178.491=-4.068
σ0.021-0.006=0.015
min2174.400-2178.486=-4.086
max2174.449-2178.501=-4.053
mean2630.000-2554.000=76.000
σ0.000
min2630.000-2554.000=76.000
max2630.000-2554.000=76.000
mean3.011-3.415=-0.404
σ0.331-0.106=0.224
min2.804-3.269=-0.465
max3.579-3.546=0.033
iters=5
new-facts=6402
prior-facts=1
mean5052.605-5056.400=-3.795
σ0.977-0.974=0.004
min5052.031-5055.856=-3.825
max5054.343-5058.134=-3.791
mean2630.000-2554.000=76.000
σ0.000
min2630.000-2554.000=76.000
max2630.000-2554.000=76.000
mean9.031-8.914=0.117
σ0.438-0.507=-0.070
min8.497-8.156=0.341
max9.514-9.416=0.098
iters=5
new-facts=6402
prior-facts=6402
mean5188.398-5193.802=-5.404
σ0.126-0.086=0.040
min5188.221-5193.730=-5.509
max5188.524-5193.900=-5.375
mean3215.600-3232.000=-16.400
σ499.782-368.640=131.142
min2630.000-2713.000=-83.000
max3891.000-3677.000=214.000
mean8.754-8.929=-0.175
σ0.167-0.449=-0.282
min8.616-8.663=-0.048
max9.045-9.724=-0.679

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.211-1.298=-0.087
σ0.262-0.370=-0.109
min0.945-0.961=-0.015
max1.548-1.875=-0.326

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.855-465.536=-0.681
σ572.656-572.658=-0.002
min178.524-179.203=-0.679
max1323.839-1324.523=-0.684
mean79.500
σ7.000
min76.000
max90.000
mean2630.000-2554.000=76.000
σ0.000
min2630.000-2554.000=76.000
max2630.000-2554.000=76.000
mean0.566-0.551=0.015
σ0.562-0.539=0.023
min0.280-0.279=0.000
max1.409-1.360=0.049
policies=20
mean1785.488-1792.280=-6.792
σ0.344-0.351=-0.007
min1785.253-1792.051=-6.799
max1785.997-1792.802=-6.805
mean760.000
σ0.000
min760.000
max760.000
mean2630.000-2554.000=76.000
σ0.000
min2630.000-2554.000=76.000
max2630.000-2554.000=76.000
mean2.802-2.787=0.015
σ0.019-0.014=0.005
min2.782-2.772=0.010
max2.827-2.805=0.022
policies=200
mean17861.410-17929.582=-68.172
σ0.573-0.511=0.062
min17861.070-17929.282=-68.212
max17862.267-17930.343=-68.077
mean7600.000
σ0.000
min7600.000
max7600.000
mean2630.000-2554.000=76.000
σ0.000
min2630.000-2554.000=76.000
max2630.000-2554.000=76.000
mean28.342-28.210=0.133
σ0.081-0.177=-0.096
min28.250-28.046=0.204
max28.417-28.382=0.035