Compare commits

Home / Compare ec94998a .. 45c4f9d8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.726-36.727=-0.000
σ0.614-1.039=-0.426
min35.923-35.919=0.004
max37.214-38.461=-1.247
mean3977.000-3984.000=-7.000
σ0.000
min3977.000-3984.000=-7.000
max3977.000-3984.000=-7.000
mean0.075-0.075=0.000
σ0.001-0.001=-0.001
min0.074-0.073=0.001
max0.076-0.078=-0.002
cache=y
dps=1
iters=10
policies=100
mean26.710-26.711=-0.000
σ0.583-0.649=-0.066
min26.209-26.203=0.006
max27.463-27.467=-0.004
mean3977.000-3984.000=-7.000
σ0.000
min3977.000-3984.000=-7.000
max3977.000-3984.000=-7.000
mean0.060-0.060=0.000
σ0.001-0.001=-0.000
min0.059-0.058=0.001
max0.061-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.357-1756.359=-0.002
σ0.373-0.373=0.000
min1755.785-1755.778=0.007
max1756.957-1756.960=-0.002
mean1670.400-1655.350=15.050
σ620.021-627.298=-7.277
min667.000-681.000=-14.000
max2599.000-2605.000=-6.000
mean2.274-2.243=0.030
σ0.146-0.158=-0.012
min2.150-2.094=0.055
max2.785-2.780=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.672-278.673=-0.001
σ0.014-0.012=0.001
min278.659-278.663=-0.004
max278.693-278.693=0.001
mean2599.000-2605.000=-6.000
σ0.000
min2599.000-2605.000=-6.000
max2599.000-2605.000=-6.000
mean0.421-0.423=-0.001
σ0.003-0.010=-0.007
min0.420-0.417=0.002
max0.426-0.440=-0.014
iters=5
new-facts=1
prior-facts=6402
mean2268.847-2268.839=0.007
σ0.003-0.016=-0.013
min2268.844-2268.811=0.033
max2268.851-2268.852=-0.001
mean2599.000-2605.000=-6.000
σ0.000
min2599.000-2605.000=-6.000
max2599.000-2605.000=-6.000
mean2.972-2.964=0.008
σ0.143-0.119=0.023
min2.893-2.884=0.009
max3.226-3.174=0.052
iters=5
new-facts=6402
prior-facts=1
mean4952.324-4952.317=0.008
σ0.809-0.868=-0.059
min4951.867-4951.868=-0.001
max4953.769-4953.866=-0.097
mean2599.000-2605.000=-6.000
σ0.000
min2599.000-2605.000=-6.000
max2599.000-2605.000=-6.000
mean8.084-8.095=-0.011
σ0.230-0.270=-0.039
min7.832-7.712=0.120
max8.407-8.355=0.053
iters=5
new-facts=6402
prior-facts=6402
mean5167.050-5166.979=0.071
σ0.014-0.162=-0.148
min5167.038-5166.690=0.348
max5167.072-5167.065=0.007
mean3414.600-3421.200=-6.600
σ463.377-458.573=4.804
min2761.000-2779.000=-18.000
max3977.000-3984.000=-7.000
mean9.310-9.268=0.042
σ0.240-0.353=-0.114
min9.070-8.745=0.325
max9.678-9.718=-0.040

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.062-1.143=-0.080
σ0.125-0.252=-0.127
min0.950-0.935=0.015
max1.258-1.534=-0.276

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-460.254=-0.001
σ572.606-572.608=-0.002
min173.947-173.949=-0.002
max1319.162-1319.166=-0.004
mean79.500
σ7.000
min76.000
max90.000
mean438.000-435.000=3.000
σ0.000
min438.000-435.000=3.000
max438.000-435.000=3.000
mean0.550-0.553=-0.003
σ0.554-0.560=-0.006
min0.272-0.271=0.001
max1.381-1.393=-0.012
policies=20
mean1740.001-1739.999=0.002
σ0.334-0.326=0.008
min1739.763-1739.762=0.001
max1740.493-1740.478=0.014
mean760.000
σ0.000
min760.000
max760.000
mean449.250-445.000=4.250
σ10.308-9.381=0.927
min438.000-435.000=3.000
max458.000-453.000=5.000
mean2.663-2.664=-0.001
σ0.011-0.008=0.004
min2.649-2.654=-0.005
max2.676-2.671=0.005
policies=200
mean17409.313-17409.298=0.015
σ0.057-0.046=0.011
min17409.236-17409.244=-0.008
max17409.371-17409.357=0.014
mean7600.000
σ0.000
min7600.000
max7600.000
mean495.750-489.750=6.000
σ2.754-3.862=-1.108
min493.000-486.000=7.000
max499.000-495.000=4.000
mean26.868-26.876=-0.008
σ0.112-0.105=0.007
min26.761-26.782=-0.021
max26.999-27.014=-0.015