Compare commits

Home / Compare a9ebc6c1 .. c4b6962e

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.707-70.707=-0.001
σ0.049-0.044=0.005
min70.678-70.680=-0.002
max70.842-70.829=0.013
mean411.600-413.000=-1.400
σ0.516-0.000=0.516
min411.000-413.000=-2.000
max412.000-413.000=-1.000
mean0.156-0.162=-0.006
σ0.007-0.003=0.004
min0.149-0.159=-0.010
max0.166-0.168=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.410-21.412=-0.002
σ0.002-0.004=-0.002
min21.407-21.405=0.002
max21.415-21.418=-0.004
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.061-0.065=-0.005
σ0.002-0.003=-0.000
min0.059-0.064=-0.005
max0.068-0.073=-0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.933-1717.009=37.924
σ0.361-169.605=-169.244
min1754.365-996.440=757.925
max1755.514-1755.513=0.001
mean1639.250-1635.450=3.800
σ596.982-600.273=-3.291
min675.000-623.000=52.000
max2432.000-2518.000=-86.000
mean2.857-2.810=0.047
σ0.094-0.352=-0.259
min2.669-1.393=1.276
max3.007-3.029=-0.022

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.792-272.791=0.000
σ0.003-0.008=-0.004
min272.789-272.782=0.007
max272.797-272.803=-0.006
mean2432.000-2518.000=-86.000
σ0.000
min2432.000-2518.000=-86.000
max2432.000-2518.000=-86.000
mean0.379-0.379=0.001
σ0.007-0.005=0.001
min0.376-0.375=0.001
max0.391-0.388=0.004
iters=5
new-facts=1
prior-facts=6402
mean1933.227-1933.218=0.009
σ0.021-0.010=0.011
min1933.200-1933.205=-0.005
max1933.249-1933.233=0.017
mean2432.000-2518.000=-86.000
σ0.000
min2432.000-2518.000=-86.000
max2432.000-2518.000=-86.000
mean2.937-2.989=-0.052
σ0.308-0.121=0.187
min2.392-2.873=-0.481
max3.134-3.181=-0.047
iters=5
new-facts=6402
prior-facts=1
mean4756.821-4756.730=0.091
σ7.720-7.377=0.344
min4752.909-4752.891=0.018
max4770.623-4769.913=0.710
mean2432.000-2518.000=-86.000
σ0.000
min2432.000-2518.000=-86.000
max2432.000-2518.000=-86.000
mean8.667-8.636=0.030
σ0.486-0.409=0.077
min7.942-8.209=-0.267
max9.058-9.086=-0.029
iters=5
new-facts=6402
prior-facts=6402
mean4944.449-4944.452=-0.003
σ0.021-0.027=-0.005
min4944.429-4944.415=0.014
max4944.476-4944.481=-0.005
mean2962.000-2938.200=23.800
σ277.383-296.406=-19.023
min2589.000-2518.000=71.000
max3321.000-3305.000=16.000
mean8.538-8.484=0.054
σ0.149-0.169=-0.020
min8.424-8.293=0.132
max8.796-8.700=0.096

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.757-1.501=0.256
σ0.055-0.334=-0.279
min1.681-1.051=0.630
max1.822-1.804=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.301-468.307=-0.005
σ574.222-574.231=-0.010
min181.187-181.184=0.003
max1329.633-1329.653=-0.020
mean88.250
σ8.500
min84.000
max101.000
mean2432.000-2518.000=-86.000
σ0.000
min2432.000-2518.000=-86.000
max2432.000-2518.000=-86.000
mean0.567-0.544=0.023
σ0.569-0.515=0.054
min0.282-0.283=-0.001
max1.420-1.316=0.104
policies=20
mean1812.161-1812.153=0.008
σ0.387-0.386=0.002
min1811.907-1811.906=0.001
max1812.735-1812.726=0.009
mean840.000
σ0.000
min840.000
max840.000
mean2432.000-2518.000=-86.000
σ0.000
min2432.000-2518.000=-86.000
max2432.000-2518.000=-86.000
mean2.814-2.801=0.014
σ0.007-0.009=-0.002
min2.806-2.792=0.014
max2.820-2.810=0.010
policies=200
mean18129.106-18129.122=-0.016
σ0.531-0.514=0.016
min18128.671-18128.733=-0.062
max18129.876-18129.875=0.001
mean8400.000
σ0.000
min8400.000
max8400.000
mean2432.000-2518.000=-86.000
σ0.000
min2432.000-2518.000=-86.000
max2432.000-2518.000=-86.000
mean28.349-28.336=0.013
σ0.113-0.035=0.078
min28.233-28.301=-0.068
max28.458-28.381=0.076