Compare commits

Home / Compare e4161d4f .. b0b2c2b3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.373-70.375=-0.002
σ0.057-0.057=-0.000
min70.339-70.340=-0.000
max70.532-70.534=-0.002
mean416.000-414.000=2.000
σ0.000
min416.000-414.000=2.000
max416.000-414.000=2.000
mean0.160-0.163=-0.003
σ0.002-0.003=-0.001
min0.157-0.156=0.001
max0.164-0.168=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.141-21.143=-0.002
σ0.003-0.002=0.000
min21.138-21.140=-0.002
max21.145-21.145=0.000
mean417.000-414.000=3.000
σ0.000
min417.000-414.000=3.000
max417.000-414.000=3.000
mean0.059-0.063=-0.004
σ0.002-0.003=-0.001
min0.058-0.060=-0.003
max0.066-0.071=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1752.198=0.001
σ0.360-0.361=-0.001
min1751.628-1751.630=-0.001
max1752.786-1752.763=0.022
mean1643.700-1633.600=10.100
σ622.714-615.710=7.003
min672.000-644.000=28.000
max2503.000-2465.000=38.000
mean2.791-2.773=0.019
σ0.189-0.169=0.020
min2.367-2.257=0.110
max3.158-3.015=0.142

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.936-269.932=0.004
σ0.010-0.005=0.004
min269.928-269.926=0.002
max269.952-269.939=0.013
mean2503.000-2465.000=38.000
σ0.000
min2503.000-2465.000=38.000
max2503.000-2465.000=38.000
mean0.382-0.371=0.010
σ0.010-0.005=0.005
min0.372-0.367=0.004
max0.398-0.380=0.018
iters=5
new-facts=1
prior-facts=6402
mean1930.397-1930.390=0.007
σ0.007-0.010=-0.004
min1930.388-1930.377=0.011
max1930.407-1930.405=0.002
mean2503.000-2465.000=38.000
σ0.000
min2503.000-2465.000=38.000
max2503.000-2465.000=38.000
mean2.523-2.530=-0.007
σ0.114-0.150=-0.036
min2.448-2.438=0.010
max2.720-2.796=-0.076
iters=5
new-facts=6402
prior-facts=1
mean4750.629-4750.865=-0.236
σ0.752-0.798=-0.045
min4749.903-4750.287=-0.385
max4751.897-4752.264=-0.367
mean2503.000-2465.000=38.000
σ0.000
min2503.000-2465.000=38.000
max2503.000-2465.000=38.000
mean8.676-8.504=0.172
σ0.655-0.317=0.338
min7.660-8.241=-0.581
max9.246-9.035=0.212
iters=5
new-facts=6402
prior-facts=6402
mean4941.336-4941.330=0.006
σ0.088-0.092=-0.004
min4941.266-4941.247=0.019
max4941.435-4941.434=0.001
mean3020.400-2982.000=38.400
σ262.230-283.603=-21.372
min2628.000-2594.000=34.000
max3328.000-3317.000=11.000
mean8.504-8.479=0.025
σ0.116-0.154=-0.038
min8.371-8.350=0.021
max8.635-8.670=-0.035

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.661-1.780=-0.118
σ0.183-0.179=0.003
min1.444-1.606=-0.161
max1.850-2.083=-0.233

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.903-465.898=0.006
σ575.759-575.753=0.006
min178.022-178.018=0.004
max1329.541-1329.528=0.014
mean81.750
σ7.500
min78.000
max93.000
mean2503.000-2465.000=38.000
σ0.000
min2503.000-2465.000=38.000
max2503.000-2465.000=38.000
mean0.538-0.538=0.000
σ0.521-0.512=0.008
min0.278-0.275=0.003
max1.319-1.306=0.013
policies=20
mean1780.476-1780.426=0.050
σ0.356-0.360=-0.005
min1780.230-1780.185=0.045
max1781.003-1780.960=0.043
mean780.000
σ0.000
min780.000
max780.000
mean2503.000-2465.000=38.000
σ0.000
min2503.000-2465.000=38.000
max2503.000-2465.000=38.000
mean2.751-2.763=-0.012
σ0.012-0.022=-0.010
min2.742-2.739=0.003
max2.768-2.782=-0.014
policies=200
mean17811.520-17811.136=0.383
σ0.501-0.620=-0.119
min17811.248-17810.753=0.495
max17812.270-17812.062=0.209
mean7800.000
σ0.000
min7800.000
max7800.000
mean2503.000-2465.000=38.000
σ0.000
min2503.000-2465.000=38.000
max2503.000-2465.000=38.000
mean27.810-27.703=0.106
σ0.072-0.101=-0.029
min27.735-27.645=0.091
max27.904-27.854=0.050