Compare commits

Home / Compare 9b43b897 .. 90176fcb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.970-53.970=0.000
σ0.368-0.367=0.001
min53.830-53.825=0.005
max55.017-55.015=0.002
mean419.000-415.700=3.300
σ0.000-0.483=-0.483
min419.000-415.000=4.000
max419.000-416.000=3.000
mean0.137-0.137=-0.000
σ0.005-0.006=-0.001
min0.130-0.129=0.001
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.342-43.343=-0.000
σ0.007-0.007=-0.000
min43.330-43.332=-0.002
max43.354-43.357=-0.003
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.122-0.123=-0.001
σ0.003-0.004=-0.001
min0.118-0.116=0.002
max0.127-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1016.895-1016.898=-0.003
σ1.160-1.151=0.008
min1016.321-1016.321=0.000
max1021.748-1021.713=0.035
mean1065.600-1058.900=6.700
σ316.929-312.321=4.608
min606.000-578.000=28.000
max1632.000-1631.000=1.000
mean1.530-1.504=0.027
σ0.093-0.055=0.038
min1.438-1.405=0.033
max1.793-1.648=0.145

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean301.872-301.935=-0.063
σ0.224-0.180=0.044
min301.704-301.706=-0.002
max302.488-302.356=0.132
mean2031.000-2033.000=-2.000
σ0.000
min2031.000-2033.000=-2.000
max2031.000-2033.000=-2.000
mean0.584-0.568=0.016
σ0.021-0.035=-0.015
min0.544-0.510=0.034
max0.605-0.607=-0.002

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean303.510-303.508=0.002
σ0.059-0.061=-0.002
min303.414-303.412=0.002
max303.561-303.566=-0.005
mean1632.000-1631.000=1.000
σ0.000
min1632.000-1631.000=1.000
max1632.000-1631.000=1.000
mean0.389-0.389=0.000
σ0.001-0.004=-0.003
min0.388-0.386=0.002
max0.391-0.394=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1326.056-1326.068=-0.012
σ0.100-0.114=-0.014
min1325.931-1325.929=0.002
max1326.183-1326.193=-0.010
mean1632.000-1631.000=1.000
σ0.000
min1632.000-1631.000=1.000
max1632.000-1631.000=1.000
mean1.904-1.908=-0.004
σ0.068-0.099=-0.030
min1.837-1.828=0.008
max1.992-2.071=-0.080
iters=5
new-facts=6402
prior-facts=1
mean1564.135-1564.121=0.015
σ6.921-6.921=-0.000
min1560.837-1560.822=0.015
max1576.513-1576.498=0.015
mean1632.000-1631.000=1.000
σ0.000
min1632.000-1631.000=1.000
max1632.000-1631.000=1.000
mean2.379-2.326=0.053
σ0.352-0.332=0.020
min2.047-2.014=0.033
max2.804-2.762=0.042
iters=5
new-facts=6402
prior-facts=6402
mean1894.005-1894.010=-0.006
σ0.063-0.066=-0.003
min1893.894-1893.892=0.002
max1894.046-1894.050=-0.004
mean1770.000-1770.400=-0.400
σ169.294-170.496=-1.202
min1632.000-1631.000=1.000
max2031.000-2033.000=-2.000
mean2.923-2.995=-0.072
σ0.117-0.295=-0.178
min2.853-2.800=0.053
max3.131-3.519=-0.388

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.197-1.223=-0.026
σ0.280-0.315=-0.036
min1.012-1.034=-0.022
max1.676-1.777=-0.101

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean444.705-444.703=0.002
σ575.148-575.144=0.005
min157.130-157.128=0.001
max1307.427-1307.419=0.009
mean96.250
σ8.500
min92.000
max109.000
mean1632.000-1631.000=1.000
σ0.000
min1632.000-1631.000=1.000
max1632.000-1631.000=1.000
mean0.540-0.525=0.014
σ0.559-0.525=0.034
min0.258-0.259=-0.002
max1.379-1.313=0.065
policies=20
mean1571.548-1571.539=0.008
σ0.321-0.329=-0.009
min1571.360-1571.355=0.004
max1572.028-1572.033=-0.005
mean920.000
σ0.000
min920.000
max920.000
mean1632.000-1631.000=1.000
σ0.000
min1632.000-1631.000=1.000
max1632.000-1631.000=1.000
mean2.614-2.619=-0.005
σ0.016-0.007=0.009
min2.595-2.613=-0.018
max2.634-2.628=0.006
policies=200
mean15723.373-15723.322=0.051
σ0.055-0.080=-0.025
min15723.295-15723.224=0.071
max15723.425-15723.394=0.031
mean9200.000
σ0.000
min9200.000
max9200.000
mean1632.000-1631.000=1.000
σ0.000
min1632.000-1631.000=1.000
max1632.000-1631.000=1.000
mean26.610-26.664=-0.053
σ0.240-0.383=-0.142
min26.342-26.306=0.036
max26.856-27.187=-0.331