Compare commits

Home / Compare c5b9e590 .. 9be65615

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.782-70.781=0.001
σ0.047-0.046=0.002
min70.746-70.747=-0.001
max70.912-70.907=0.005
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.160-0.159=0.001
σ0.005-0.006=-0.000
min0.151-0.150=0.001
max0.167-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.493-21.492=0.000
σ0.003-0.003=0.001
min21.487-21.488=-0.000
max21.499-21.496=0.003
mean415.000-413.000=2.000
σ0.000
min415.000-413.000=2.000
max415.000-413.000=2.000
mean0.066-0.065=0.001
σ0.002-0.003=-0.000
min0.063-0.064=-0.000
max0.072-0.072=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.898-1754.897=0.002
σ0.361-0.360=0.001
min1754.325-1754.339=-0.015
max1755.480-1755.478=0.002
mean1668.400-1655.400=13.000
σ642.026-623.397=18.629
min667.000-663.000=4.000
max2712.000-2501.000=211.000
mean2.812-2.846=-0.034
σ0.164-0.162=0.002
min2.266-2.533=-0.268
max3.041-3.129=-0.088

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.758-272.759=-0.001
σ0.006-0.004=0.001
min272.752-272.754=-0.002
max272.766-272.763=0.003
mean2712.000-2501.000=211.000
σ0.000
min2712.000-2501.000=211.000
max2712.000-2501.000=211.000
mean0.384-0.387=-0.003
σ0.003-0.005=-0.003
min0.381-0.381=-0.001
max0.387-0.394=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1933.137-1933.127=0.010
σ0.011-0.011=-0.001
min1933.123-1933.114=0.009
max1933.150-1933.140=0.010
mean2712.000-2501.000=211.000
σ0.000
min2712.000-2501.000=211.000
max2712.000-2501.000=211.000
mean3.044-2.912=0.132
σ0.041-0.154=-0.113
min2.997-2.706=0.290
max3.091-3.032=0.059
iters=5
new-facts=6402
prior-facts=1
mean4753.933-4753.875=0.058
σ0.894-0.927=-0.033
min4753.382-4753.383=-0.001
max4755.523-4755.530=-0.007
mean2712.000-2501.000=211.000
σ0.000
min2712.000-2501.000=211.000
max2712.000-2501.000=211.000
mean8.377-8.606=-0.229
σ0.431-0.508=-0.077
min7.913-7.788=0.125
max8.982-9.056=-0.074
iters=5
new-facts=6402
prior-facts=6402
mean4944.292-4944.361=-0.069
σ0.163-0.012=0.151
min4944.001-4944.349=-0.348
max4944.375-4944.376=-0.001
mean2976.200-2925.600=50.600
σ318.487-383.235=-64.747
min2712.000-2501.000=211.000
max3452.000-3467.000=-15.000
mean8.364-8.394=-0.031
σ0.048-0.060=-0.012
min8.283-8.341=-0.058
max8.405-8.493=-0.088

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.100-1.708=-0.608
σ0.189-0.212=-0.023
min0.924-1.358=-0.434
max1.352-1.872=-0.520

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.666-468.653=0.014
σ574.946-574.925=0.022
min181.188-181.187=0.002
max1331.085-1331.039=0.046
mean88.250
σ8.500
min84.000
max101.000
mean2712.000-2501.000=211.000
σ0.000
min2712.000-2501.000=211.000
max2712.000-2501.000=211.000
mean0.561-0.565=-0.004
σ0.547-0.544=0.003
min0.286-0.288=-0.002
max1.382-1.381=0.000
policies=20
mean1812.200-1812.175=0.024
σ0.384-0.392=-0.008
min1811.938-1811.914=0.024
max1812.766-1812.754=0.012
mean840.000
σ0.000
min840.000
max840.000
mean2712.000-2501.000=211.000
σ0.000
min2712.000-2501.000=211.000
max2712.000-2501.000=211.000
mean2.829-2.846=-0.017
σ0.016-0.013=0.003
min2.812-2.827=-0.015
max2.848-2.859=-0.011
policies=200
mean18129.072-18129.172=-0.100
σ0.612-0.508=0.104
min18128.682-18128.834=-0.152
max18129.980-18129.925=0.054
mean8400.000
σ0.000
min8400.000
max8400.000
mean2712.000-2501.000=211.000
σ0.000
min2712.000-2501.000=211.000
max2712.000-2501.000=211.000
mean28.615-28.693=-0.078
σ0.055-0.133=-0.078
min28.565-28.504=0.060
max28.676-28.809=-0.134