Compare commits

Home / Compare 08526ee4 .. 3f824f33

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.915=-0.000
σ0.369-0.367=0.002
min53.786-53.787=-0.001
max54.965-54.959=0.005
mean415.000-414.800=0.200
σ0.000-0.422=-0.422
min415.000-414.000=1.000
max415.000
mean0.139-0.141=-0.003
σ0.004-0.003=0.001
min0.135-0.138=-0.003
max0.146-0.147=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.140-43.140=0.000
σ0.005-0.004=0.001
min43.130-43.135=-0.005
max43.149-43.147=0.002
mean415.000
σ0.000
min415.000
max415.000
mean0.120-0.119=0.001
σ0.003-0.004=-0.001
min0.118-0.114=0.003
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.812-991.817=-0.005
σ1.224-1.221=0.003
min991.229-991.231=-0.003
max996.953-996.937=0.017
mean1068.550-1069.350=-0.800
σ314.107-317.117=-3.010
min616.000-620.000=-4.000
max1652.000-1630.000=22.000
mean1.504-1.527=-0.023
σ0.064-0.080=-0.016
min1.364-1.401=-0.037
max1.656-1.736=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.412-285.411=0.001
σ0.011-0.008=0.003
min285.395-285.398=-0.003
max285.423-285.419=0.004
mean1652.000-1630.000=22.000
σ0.000
min1652.000-1630.000=22.000
max1652.000-1630.000=22.000
mean0.377-0.381=-0.004
σ0.007-0.008=-0.001
min0.373-0.375=-0.002
max0.389-0.390=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1285.373-1285.382=-0.009
σ0.129-0.138=-0.009
min1285.311-1285.317=-0.006
max1285.604-1285.629=-0.025
mean1652.000-1630.000=22.000
σ0.000
min1652.000-1630.000=22.000
max1652.000-1630.000=22.000
mean2.034-1.958=0.076
σ0.255-0.140=0.116
min1.826-1.844=-0.018
max2.399-2.185=0.215
iters=5
new-facts=6402
prior-facts=1
mean1807.718-1807.743=-0.025
σ7.008-6.998=0.009
min1804.346-1804.389=-0.043
max1820.238-1820.246=-0.009
mean1652.000-1630.000=22.000
σ0.000
min1652.000-1630.000=22.000
max1652.000-1630.000=22.000
mean4.178-4.266=-0.088
σ0.194-0.165=0.028
min3.877-4.111=-0.235
max4.413-4.460=-0.047
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.201=-0.006
σ0.010-0.012=-0.002
min2070.182-2070.189=-0.007
max2070.209-2070.222=-0.013
mean1834.400-1849.200=-14.800
σ165.175-190.451=-25.276
min1652.000-1630.000=22.000
max2068.000-2086.000=-18.000
mean4.586-4.560=0.026
σ0.194-0.117=0.077
min4.470-4.433=0.037
max4.929-4.721=0.208

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.182-1.211=-0.029
σ0.293-0.329=-0.036
min0.911-0.914=-0.003
max1.675-1.762=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.781-436.781=-0.000
σ572.364-572.360=0.004
min150.596-150.596=0.000
max1295.327-1295.321=0.005
mean90.250
σ8.500
min86.000
max103.000
mean1652.000-1630.000=22.000
σ0.000
min1652.000-1630.000=22.000
max1652.000-1630.000=22.000
mean0.529-0.498=0.032
σ0.554-0.498=0.056
min0.249-0.248=0.001
max1.360-1.245=0.115
policies=20
mean1506.258-1506.258=-0.000
σ0.243-0.242=0.001
min1506.109-1506.098=0.011
max1506.621-1506.618=0.003
mean860.000
σ0.000
min860.000
max860.000
mean1652.000-1630.000=22.000
σ0.000
min1652.000-1630.000=22.000
max1652.000-1630.000=22.000
mean2.525-2.519=0.006
σ0.022-0.030=-0.008
min2.503-2.491=0.011
max2.547-2.561=-0.014
policies=200
mean15070.357-15070.291=0.065
σ0.076-0.089=-0.014
min15070.262-15070.191=0.071
max15070.423-15070.401=0.022
mean8600.000
σ0.000
min8600.000
max8600.000
mean1652.000-1630.000=22.000
σ0.000
min1652.000-1630.000=22.000
max1652.000-1630.000=22.000
mean25.481-25.446=0.035
σ0.099-0.155=-0.056
min25.377-25.230=0.147
max25.594-25.577=0.017