Compare commits

Home / Compare ecf190d7 .. 4d776bae

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.262-35.263=-0.001
σ0.054-0.054=0.001
min35.236-35.238=-0.001
max35.415-35.414=0.001
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.081-0.083=-0.002
σ0.006-0.005=0.001
min0.076-0.076=-0.000
max0.091-0.092=-0.000
cache=y
dps=1
iters=10
policies=100
mean23.770-23.770=0.001
σ0.002-0.004=-0.002
min23.768-23.765=0.003
max23.772-23.778=-0.006
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.067-0.067=0.000
σ0.003-0.005=-0.001
min0.061-0.062=-0.001
max0.074-0.075=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.484-1756.485=-0.001
σ0.364-0.366=-0.002
min1755.911-1755.909=0.002
max1757.070-1757.075=-0.005
mean1650.200-1648.500=1.700
σ639.807-639.635=0.172
min627.000-625.000=2.000
max2825.000-2826.000=-1.000
mean2.357-2.341=0.016
σ0.082-0.073=0.009
min2.172-2.244=-0.072
max2.502-2.490=0.012

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.714-324.712=0.002
σ0.037-0.037=-0.000
min324.649-324.648=0.001
max324.742-324.742=-0.000
mean2825.000-2826.000=-1.000
σ0.000
min2825.000-2826.000=-1.000
max2825.000-2826.000=-1.000
mean0.422-0.423=-0.001
σ0.002-0.002=-0.000
min0.421-0.420=0.001
max0.425-0.425=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1985.260-1985.273=-0.013
σ0.018-0.006=0.013
min1985.236-1985.268=-0.032
max1985.279-1985.281=-0.003
mean2825.000-2826.000=-1.000
σ0.000
min2825.000-2826.000=-1.000
max2825.000-2826.000=-1.000
mean2.687-2.601=0.087
σ0.079-0.046=0.032
min2.595-2.549=0.046
max2.782-2.653=0.129
iters=5
new-facts=6402
prior-facts=1
mean4668.264-4808.852=-140.588
σ316.471-7.688=308.784
min4102.297-4805.370=-703.073
max4822.545-4822.604=-0.059
mean2825.000-2826.000=-1.000
σ0.000
min2825.000-2826.000=-1.000
max2825.000-2826.000=-1.000
mean8.630-8.775=-0.145
σ0.495-0.117=0.378
min7.792-8.582=-0.790
max9.039-8.887=0.151
iters=5
new-facts=6402
prior-facts=6402
mean4996.485-4996.411=0.074
σ0.032-0.141=-0.109
min4996.446-4996.160=0.286
max4996.526-4996.489=0.037
mean3058.400-3050.200=8.200
σ238.772-204.294=34.478
min2825.000-2826.000=-1.000
max3302.000-3346.000=-44.000
mean8.895-8.662=0.233
σ0.359-0.222=0.137
min8.622-8.416=0.206
max9.493-9.010=0.483

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.957-0.977=-0.020
σ0.056-0.068=-0.012
min0.925-0.917=0.008
max1.056-1.062=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.956-462.960=-0.004
σ574.254-574.254=0.000
min175.820-175.822=-0.002
max1324.338-1324.341=-0.004
mean86.250
σ8.500
min82.000
max99.000
mean2825.000-2826.000=-1.000
σ0.000
min2825.000-2826.000=-1.000
max2825.000-2826.000=-1.000
mean0.431-0.436=-0.006
σ0.300-0.305=-0.005
min0.277-0.280=-0.003
max0.881-0.894=-0.013
policies=20
mean1758.535-1758.569=-0.033
σ0.352-0.348=0.004
min1758.295-1758.332=-0.037
max1759.057-1759.083=-0.027
mean820.000
σ0.000
min820.000
max820.000
mean2825.000-2826.000=-1.000
σ0.000
min2825.000-2826.000=-1.000
max2825.000-2826.000=-1.000
mean2.783-2.787=-0.004
σ0.017-0.009=0.008
min2.762-2.775=-0.012
max2.799-2.794=0.005
policies=200
mean17592.532-17592.490=0.041
σ0.541-0.550=-0.009
min17592.153-17592.099=0.054
max17593.323-17593.305=0.018
mean8200.000
σ0.000
min8200.000
max8200.000
mean2825.000-2826.000=-1.000
σ0.000
min2825.000-2826.000=-1.000
max2825.000-2826.000=-1.000
mean27.792-27.828=-0.036
σ0.324-0.328=-0.003
min27.423-27.493=-0.070
max28.154-28.247=-0.094