Compare commits

Home / Compare 4d91f174 .. cc4225e7

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.853-36.728=0.125
σ0.876-1.040=-0.164
min35.927-35.926=0.000
max38.495-38.465=0.030
mean3948.000-3981.000=-33.000
σ0.000
min3948.000-3981.000=-33.000
max3948.000-3981.000=-33.000
mean0.096-0.075=0.020
σ0.071-0.001=0.070
min0.070-0.074=-0.004
max0.297-0.076=0.220
cache=y
dps=1
iters=10
policies=100
mean26.586-26.712=-0.126
σ0.606-0.648=-0.042
min26.204-26.205=-0.001
max27.470-27.468=0.002
mean3948.000-3981.000=-33.000
σ0.000
min3948.000-3981.000=-33.000
max3948.000-3981.000=-33.000
mean0.060-0.061=-0.000
σ0.001-0.001=0.000
min0.059-0.060=-0.000
max0.062-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.372-1756.367=0.006
σ0.372-0.372=0.000
min1755.801-1755.790=0.012
max1756.972-1756.962=0.010
mean1655.250-1660.800=-5.550
σ625.688-627.910=-2.222
min614.000-618.000=-4.000
max2640.000-2636.000=4.000
mean2.271-2.310=-0.038
σ0.154-0.227=-0.073
min2.106-2.157=-0.052
max2.767-3.062=-0.295

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.702-278.701=0.002
σ0.014-0.010=0.004
min278.689-278.690=-0.001
max278.725-278.716=0.009
mean2640.000-2636.000=4.000
σ0.000
min2640.000-2636.000=4.000
max2640.000-2636.000=4.000
mean0.419-0.418=0.001
σ0.001-0.001=0.000
min0.417-0.417=0.000
max0.420-0.420=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.874-2268.867=0.007
σ0.008-0.005=0.002
min2268.862-2268.860=0.003
max2268.883-2268.873=0.010
mean2640.000-2636.000=4.000
σ0.000
min2640.000-2636.000=4.000
max2640.000-2636.000=4.000
mean2.940-2.928=0.012
σ0.043-0.056=-0.013
min2.906-2.865=0.041
max3.013-3.007=0.005
iters=5
new-facts=6402
prior-facts=1
mean4952.343-4952.226=0.116
σ0.787-0.867=-0.080
min4951.888-4951.499=0.389
max4953.745-4953.731=0.014
mean2640.000-2636.000=4.000
σ0.000
min2640.000-2636.000=4.000
max2640.000-2636.000=4.000
mean8.031-8.002=0.029
σ0.247-0.278=-0.032
min7.834-7.714=0.119
max8.438-8.404=0.034
iters=5
new-facts=6402
prior-facts=6402
mean5167.014-5167.075=-0.061
σ0.163-0.009=0.155
min5166.724-5167.067=-0.344
max5167.102-5167.089=0.013
mean3366.200-3418.000=-51.800
σ445.930-451.231=-5.300
min2770.000-2806.000=-36.000
max3948.000-3981.000=-33.000
mean9.371-9.146=0.225
σ0.503-0.120=0.382
min8.970-8.992=-0.022
max10.229-9.265=0.964

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.055-1.070=-0.015
σ0.115-0.271=-0.156
min0.946-0.945=0.001
max1.232-1.555=-0.323

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.269-460.258=0.011
σ572.609-572.606=0.003
min173.963-173.954=0.009
max1319.182-1319.167=0.015
mean79.500
σ7.000
min76.000
max90.000
mean435.000-436.000=-1.000
σ0.000
min435.000-436.000=-1.000
max435.000-436.000=-1.000
mean0.544-0.553=-0.009
σ0.536-0.558=-0.022
min0.275-0.271=0.003
max1.348-1.390=-0.042
policies=20
mean1740.143-1740.034=0.109
σ0.339-0.326=0.013
min1739.904-1739.801=0.104
max1740.642-1740.513=0.129
mean760.000
σ0.000
min760.000
max760.000
mean445.500-446.500=-1.000
σ9.950
min435.000-436.000=-1.000
max454.000-455.000=-1.000
mean2.668-2.659=0.008
σ0.028-0.014=0.015
min2.631-2.645=-0.014
max2.701-2.677=0.023
policies=200
mean17410.668-17409.856=0.811
σ0.061-0.146=-0.085
min17410.598-17409.688=0.910
max17410.731-17410.000=0.731
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.750-491.250=-2.500
σ1.708-2.062=-0.354
min487.000-489.000=-2.000
max491.000-494.000=-3.000
mean26.919-26.977=-0.058
σ0.125-0.130=-0.005
min26.758-26.819=-0.062
max27.062-27.117=-0.055