Compare commits

Home / Compare 02fabb12 .. 61d8d00a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean73.045-73.046=-0.001
σ0.047-0.047=0.000
min73.023-73.020=0.003
max73.178-73.178=0.000
mean417.400-416.000=1.400
σ0.516-0.000=0.516
min417.000-416.000=1.000
max418.000-416.000=2.000
mean0.157-0.162=-0.005
σ0.007-0.004=0.003
min0.149-0.157=-0.008
max0.169-0.169=0.000
cache=y
dps=1
iters=10
policies=100
mean23.740-23.740=-0.001
σ0.003-0.004=-0.001
min23.736-23.737=-0.000
max23.746-23.748=-0.001
mean418.000-416.000=2.000
σ0.000
min418.000-416.000=2.000
max418.000-416.000=2.000
mean0.064-0.064=-0.000
σ0.002-0.003=-0.001
min0.060-0.061=-0.001
max0.065-0.072=-0.007

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1720.870-1758.785=-37.914
σ169.636-0.366=169.270
min1000.169-1758.218=-758.050
max1759.369-1759.363=0.005
mean1615.000-1681.700=-66.700
σ603.726-639.635=-35.909
min675.000-674.000=1.000
max2788.000-2852.000=-64.000
mean2.786-2.838=-0.051
σ0.301-0.126=0.176
min1.594-2.468=-0.874
max3.120-3.013=0.107

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.021-324.012=0.009
σ0.038-0.053=-0.015
min323.952-323.917=0.035
max324.042-324.044=-0.002
mean2788.000-2852.000=-64.000
σ0.000
min2788.000-2852.000=-64.000
max2788.000-2852.000=-64.000
mean0.425-0.427=-0.002
σ0.001-0.001=0.000
min0.423-0.426=-0.002
max0.427-0.428=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1984.598-1984.596=0.002
σ0.006-0.005=0.000
min1984.591-1984.592=-0.001
max1984.605-1984.604=0.001
mean2788.000-2852.000=-64.000
σ0.000
min2788.000-2852.000=-64.000
max2788.000-2852.000=-64.000
mean2.576-2.565=0.011
σ0.100-0.095=0.005
min2.455-2.466=-0.011
max2.706-2.698=0.008
iters=5
new-facts=6402
prior-facts=1
mean4808.231-4808.255=-0.024
σ7.722-7.745=-0.023
min4804.730-4804.688=0.042
max4822.045-4822.110=-0.065
mean2788.000-2852.000=-64.000
σ0.000
min2788.000-2852.000=-64.000
max2788.000-2852.000=-64.000
mean8.598-8.806=-0.208
σ0.178-0.310=-0.132
min8.310-8.508=-0.198
max8.759-9.269=-0.510
iters=5
new-facts=6402
prior-facts=6402
mean4995.800-4995.805=-0.004
σ0.019-0.012=0.007
min4995.781-4995.791=-0.010
max4995.827-4995.819=0.007
mean3046.200-3047.200=-1.000
σ211.959-201.770=10.189
min2788.000-2852.000=-64.000
max3332.000-3338.000=-6.000
mean8.577-8.713=-0.136
σ0.202-0.134=0.068
min8.420-8.549=-0.129
max8.928-8.920=0.008

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.089-1.023=0.065
σ0.255-0.237=0.018
min0.906-0.916=-0.010
max1.528-1.447=0.080

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.354-468.351=0.003
σ574.239-574.228=0.011
min181.229-181.227=0.002
max1329.712-1329.693=0.019
mean88.250
σ8.500
min84.000
max101.000
mean2788.000-2852.000=-64.000
σ0.000
min2788.000-2852.000=-64.000
max2788.000-2852.000=-64.000
mean0.443-0.442=0.001
σ0.303-0.299=0.004
min0.290-0.290=-0.001
max0.897-0.890=0.007
policies=20
mean1812.598-1812.599=-0.001
σ0.402-0.409=-0.007
min1812.310-1812.305=0.005
max1813.189-1813.197=-0.008
mean840.000
σ0.000
min840.000
max840.000
mean2788.000-2852.000=-64.000
σ0.000
min2788.000-2852.000=-64.000
max2788.000-2852.000=-64.000
mean2.889-2.899=-0.011
σ0.031-0.019=0.012
min2.867-2.884=-0.017
max2.934-2.927=0.008
policies=200
mean18132.175-18132.081=0.094
σ0.588-0.579=0.009
min18131.498-18131.456=0.042
max18132.869-18132.803=0.066
mean8400.000
σ0.000
min8400.000
max8400.000
mean2788.000-2852.000=-64.000
σ0.000
min2788.000-2852.000=-64.000
max2788.000-2852.000=-64.000
mean28.660-28.683=-0.022
σ0.348-0.448=-0.100
min28.240-28.293=-0.053
max29.091-29.202=-0.111