Compare commits

Home / Compare ff1273d0 .. 3bc9710d

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.992
σ0.102
min35.948
max36.280
mean3767.000
σ0.000
min3767.000
max3767.000
mean0.077
σ0.003
min0.075
max0.082
cache=y
dps=1
iters=10
policies=100
mean26.212
σ0.006
min26.204
max26.220
mean3767.000
σ0.000
min3767.000
max3767.000
mean0.060
σ0.001
min0.059
max0.061

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.358-1756.288=0.070
σ0.373-0.366=0.006
min1755.789-1755.715=0.075
max1756.956-1756.878=0.078
mean1651.750-1656.400=-4.650
σ625.628-626.013=-0.384
min610.000-614.000=-4.000
max2659.000-2666.000=-7.000
mean2.260-2.267=-0.007
σ0.126-0.142=-0.017
min2.123-2.135=-0.012
max2.582-2.758=-0.176

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.673-278.675=-0.002
σ0.007-0.012=-0.005
min278.666-278.658=0.008
max278.683-278.690=-0.007
mean2659.000-2666.000=-7.000
σ0.000
min2659.000-2666.000=-7.000
max2659.000-2666.000=-7.000
mean0.419-0.419=-0.000
σ0.002-0.002=0.000
min0.417-0.417=-0.000
max0.422-0.421=0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.823-2268.844=-0.021
σ0.016-0.010=0.006
min2268.808-2268.832=-0.024
max2268.845-2268.855=-0.010
mean2659.000-2666.000=-7.000
σ0.000
min2659.000-2666.000=-7.000
max2659.000-2666.000=-7.000
mean3.072-3.065=0.007
σ0.149-0.145=0.005
min2.870-2.898=-0.029
max3.236-3.268=-0.032
iters=5
new-facts=6402
prior-facts=1
mean4952.172-4952.120=0.052
σ0.779-0.914=-0.135
min4951.772-4951.331=0.441
max4953.564-4953.693=-0.130
mean2659.000-2666.000=-7.000
σ0.000
min2659.000-2666.000=-7.000
max2659.000-2666.000=-7.000
mean7.839-8.061=-0.222
σ0.163-0.371=-0.208
min7.640-7.623=0.017
max8.016-8.590=-0.574
iters=5
new-facts=6402
prior-facts=6402
mean5166.897-5166.919=-0.021
σ0.013-0.226=-0.212
min5166.888-5166.535=0.353
max5166.921-5167.070=-0.150
mean3361.400-3432.600=-71.200
σ395.711-486.764=-91.053
min2977.000-2882.000=95.000
max3767.000-4161.000=-394.000
mean9.385-9.204=0.181
σ0.448-0.380=0.068
min8.986-8.745=0.241
max10.135-9.594=0.541

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.585-1.082=0.502
σ0.258-0.111=0.147
min1.234-0.942=0.292
max1.790-1.253=0.537

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.255-460.256=-0.001
σ572.608-572.607=0.001
min173.949-173.951=-0.002
max1319.167-1319.166=0.001
mean79.500
σ7.000
min76.000
max90.000
mean436.000-433.000=3.000
σ0.000
min436.000-433.000=3.000
max436.000-433.000=3.000
mean0.549-0.528=0.021
σ0.542-0.517=0.024
min0.277-0.263=0.013
max1.362-1.304=0.058
policies=20
mean1740.008-1740.015=-0.007
σ0.329-0.337=-0.009
min1739.770-1739.774=-0.005
max1740.489-1740.511=-0.022
mean760.000
σ0.000
min760.000
max760.000
mean446.000
σ9.381-11.489=-2.108
min436.000-433.000=3.000
max454.000-461.000=-7.000
mean2.654-2.682=-0.028
σ0.012-0.008=0.005
min2.643-2.671=-0.028
max2.670-2.687=-0.017
policies=200
mean17409.313-17409.427=-0.115
σ0.127-0.074=0.053
min17409.172-17409.383=-0.211
max17409.469-17409.538=-0.068
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.500-491.000=-2.500
σ1.915-2.449=-0.535
min486.000-488.000=-2.000
max490.000-493.000=-3.000
mean26.945-27.028=-0.083
σ0.096-0.143=-0.047
min26.850-26.840=0.011
max27.029-27.144=-0.115