Compare commits

Home / Compare 3fb918aa .. b790c6bb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=disabled
datapoints=1
iterations=10
mean1223.200-1223.191=0.009
σ2.286-2.289=-0.002
min1222.335-1222.326=0.009
max1229.614-1229.612=0.003
mean4082.000-3755.000=327.000
σ0.000
min4082.000-3755.000=327.000
max4082.000-3755.000=327.000
mean0.351-0.356=-0.005
σ0.010-0.006=0.004
min0.335-0.338=-0.002
max0.361-0.360=0.002
cache=enabled
datapoints=1
iterations=10
mean82.805-82.804=0.001
σ0.003-0.002=0.000
min82.801-82.801=-0.000
max82.809-82.808=0.001
mean4082.000-3755.000=327.000
σ0.000
min4082.000-3755.000=327.000
max4082.000-3755.000=327.000
mean0.041-0.041=0.000
σ0.004-0.004=0.000
min0.039-0.039=0.000
max0.054-0.053=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime_s
datapoints=1
iterations=20
mean1753.898-1753.900=-0.002
σ0.372-0.371=0.001
min1753.323-1753.328=-0.005
max1754.495-1754.492=0.004
mean1650.650-1662.050=-11.400
σ622.364-652.268=-29.904
min616.000-654.000=-38.000
max2640.000-2825.000=-185.000
mean2.712-2.735=-0.024
σ0.166-0.162=0.004
min2.290-2.438=-0.148
max3.005-3.051=-0.046

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime_s
iters=5
new-facts=1
prior-facts=1
mean190.715-190.720=-0.005
σ0.011-0.015=-0.005
min190.703-190.706=-0.002
max190.731-190.741=-0.010
mean2640.000-2825.000=-185.000
σ0.000
min2640.000-2825.000=-185.000
max2640.000-2825.000=-185.000
mean0.280-0.278=0.002
σ0.000-0.000=-0.000
min0.279-0.277=0.002
max0.281-0.279=0.002
iters=5
new-facts=1
prior-facts=6402
mean1989.495-1989.498=-0.002
σ0.012-0.016=-0.004
min1989.480-1989.479=0.001
max1989.507-1989.510=-0.004
mean2640.000-2825.000=-185.000
σ0.000
min2640.000-2825.000=-185.000
max2640.000-2825.000=-185.000
mean2.430-2.604=-0.174
σ0.111-0.106=0.006
min2.322-2.501=-0.179
max2.617-2.770=-0.154
iters=5
new-facts=6402
prior-facts=1
mean4880.171-4880.180=-0.009
σ0.597-0.577=0.021
min4879.887-4879.883=0.005
max4881.239-4881.209=0.030
mean2640.000-2825.000=-185.000
σ0.000
min2640.000-2825.000=-185.000
max2640.000-2825.000=-185.000
mean8.176-8.040=0.137
σ0.274-0.099=0.176
min7.786-7.903=-0.117
max8.483-8.147=0.336
iters=5
new-facts=6402
prior-facts=6402
mean4891.790-4891.784=0.006
σ0.012-0.009=0.003
min4891.776-4891.775=0.001
max4891.802-4891.798=0.005
mean3378.600-3321.800=56.800
σ498.576-440.965=57.611
min2770.000-2825.000=-55.000
max4082.000-3755.000=327.000
mean8.167-8.019=0.148
σ0.113-0.105=0.008
min8.042-7.941=0.101
max8.301-8.201=0.100

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.070-1.287=-0.216
σ0.138-0.330=-0.192
min0.950-0.952=-0.002
max1.288-1.802=-0.514

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime_s
policies=2
mean456.477-456.475=0.003
σ572.534-572.536=-0.001
min170.208-170.204=0.004
max1315.279-1315.278=0.001
mean79.500
σ7.000
min76.000
max90.000
mean432.000-430.500=1.500
σ0.000-0.577=-0.577
min432.000-430.000=2.000
max432.000-431.000=1.000
mean0.552-0.560=-0.008
σ0.567-0.582=-0.015
min0.262-0.261=0.000
max1.402-1.433=-0.030
policies=20
mean1702.573-1702.574=-0.001
σ0.309-0.303=0.006
min1702.357-1702.347=0.010
max1703.028-1703.017=0.012
mean760.000
σ0.000
min760.000
max760.000
mean447.000-443.500=3.500
σ12.463-11.240=1.223
min434.000-431.000=3.000
max464.000-453.000=11.000
mean2.635-2.608=0.027
σ0.014-0.006=0.007
min2.617-2.600=0.017
max2.649-2.615=0.034
policies=200
mean17035.260-17035.383=-0.122
σ0.035-0.134=-0.100
min17035.216-17035.192=0.024
max17035.301-17035.508=-0.207
mean7600.000
σ0.000
min7600.000
max7600.000
mean489.000-488.750=0.250
σ1.414-2.986=-1.572
min488.000-485.000=3.000
max491.000-492.000=-1.000
mean26.539-26.272=0.267
σ0.159-0.046=0.113
min26.363-26.230=0.132
max26.729-26.320=0.409