Compare commits

Home / Compare 6f4db6f9 .. d0aee9a6

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.956-35.957=-0.001
σ0.102-0.102=-0.000
min35.913-35.915=-0.003
max36.245-36.247=-0.001
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.076-0.075=0.001
σ0.005-0.004=0.000
min0.071-0.070=0.001
max0.083-0.084=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.204-26.203=0.000
σ0.004-0.002=0.002
min26.196-26.200=-0.003
max26.210-26.207=0.003
mean414.000-411.000=3.000
σ0.000
min414.000-411.000=3.000
max414.000-411.000=3.000
mean0.061-0.061=0.000
σ0.002-0.003=-0.001
min0.060-0.059=0.000
max0.067-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.304-1756.304=0.000
σ0.368-0.368=-0.001
min1755.729-1755.728=0.000
max1756.898-1756.897=0.001
mean1657.500-1655.150=2.350
σ636.038-627.561=8.478
min611.000-608.000=3.000
max2686.000-2640.000=46.000
mean2.399-2.364=0.035
σ0.185-0.180=0.006
min2.279-2.206=0.073
max3.102-3.068=0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.822-278.821=0.000
σ0.006-0.004=0.001
min278.813-278.816=-0.003
max278.828-278.827=0.001
mean2686.000-2640.000=46.000
σ0.000
min2686.000-2640.000=46.000
max2686.000-2640.000=46.000
mean0.414-0.410=0.003
σ0.004-0.001=0.002
min0.410-0.409=0.001
max0.419-0.412=0.007
iters=5
new-facts=1
prior-facts=6402
mean2268.884-2268.885=-0.000
σ0.018-0.016=0.002
min2268.854-2268.861=-0.007
max2268.898-2268.907=-0.009
mean2686.000-2640.000=46.000
σ0.000
min2686.000-2640.000=46.000
max2686.000-2640.000=46.000
mean2.933-3.029=-0.096
σ0.095-0.134=-0.039
min2.859-2.887=-0.028
max3.099-3.203=-0.104
iters=5
new-facts=6402
prior-facts=1
mean4954.269-4954.288=-0.020
σ0.945-0.872=0.074
min4953.689-4953.844=-0.155
max4955.946-4955.845=0.101
mean2686.000-2640.000=46.000
σ0.000
min2686.000-2640.000=46.000
max2686.000-2640.000=46.000
mean8.079-8.031=0.048
σ0.409-0.191=0.217
min7.705-7.808=-0.103
max8.649-8.278=0.371
iters=5
new-facts=6402
prior-facts=6402
mean5168.828-5168.826=0.002
σ0.096-0.090=0.005
min5168.718-5168.726=-0.008
max5168.904-5168.906=-0.002
mean3459.000-3458.400=0.600
σ472.083-495.702=-23.619
min2799.000-2845.000=-46.000
max4014.000-4166.000=-152.000
mean9.457-9.284=0.173
σ0.279-0.299=-0.020
min9.216-8.951=0.265
max9.815-9.616=0.199

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.123-1.084=0.039
σ0.247-0.168=0.079
min0.942-0.944=-0.002
max1.550-1.364=0.186

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.353-460.354=-0.001
σ572.651-572.658=-0.007
min174.021-174.011=0.010
max1319.330-1319.342=-0.012
mean79.500
σ7.000
min76.000
max90.000
mean2686.000-2640.000=46.000
σ0.000
min2686.000-2640.000=46.000
max2686.000-2640.000=46.000
mean0.562-0.564=-0.002
σ0.574-0.591=-0.018
min0.273-0.266=0.007
max1.423-1.451=-0.028
policies=20
mean1740.432-1740.429=0.003
σ0.318-0.316=0.002
min1740.232-1740.232=0.000
max1740.906-1740.901=0.005
mean760.000
σ0.000
min760.000
max760.000
mean2686.000-2640.000=46.000
σ0.000
min2686.000-2640.000=46.000
max2686.000-2640.000=46.000
mean2.673-2.688=-0.015
σ0.014-0.029=-0.015
min2.660-2.664=-0.004
max2.692-2.730=-0.038
policies=200
mean17411.210-17411.183=0.027
σ0.561-0.567=-0.006
min17410.911-17410.882=0.029
max17412.051-17412.034=0.018
mean7600.000
σ0.000
min7600.000
max7600.000
mean2686.000-2640.000=46.000
σ0.000
min2686.000-2640.000=46.000
max2686.000-2640.000=46.000
mean26.991-27.046=-0.055
σ0.063-0.034=0.029
min26.933-27.011=-0.078
max27.081-27.079=0.002