Compare commits

Home / Compare 895e7e19 .. 0d073126

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.781=-0.079
σ0.047-0.047=-0.000
min70.672-70.752=-0.079
max70.833-70.912=-0.078
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.159-0.159=-0.000
σ0.005-0.004=0.001
min0.150-0.153=-0.003
max0.166-0.164=0.002
cache=y
dps=1
iters=10
policies=100
mean21.409-21.492=-0.083
σ0.002-0.003=-0.001
min21.407-21.488=-0.081
max21.412-21.496=-0.084
mean413.000-414.000=-1.000
σ0.000
min413.000-414.000=-1.000
max413.000-414.000=-1.000
mean0.065-0.065=-0.000
σ0.002-0.003=-0.000
min0.063-0.063=-0.000
max0.072-0.073=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.930-1754.094=0.836
σ0.361-0.361=0.001
min1754.358-1753.529=0.829
max1755.513-1754.674=0.839
mean1654.150-1659.000=-4.850
σ620.755-624.168=-3.413
min680.000-683.000=-3.000
max2770.000-2748.000=22.000
mean2.776-2.829=-0.053
σ0.140-0.142=-0.003
min2.334-2.443=-0.109
max2.971-2.996=-0.024

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.791-271.957=0.834
σ0.008-0.005=0.003
min272.785-271.952=0.832
max272.804-271.964=0.840
mean2770.000-2748.000=22.000
σ0.000
min2770.000-2748.000=22.000
max2770.000-2748.000=22.000
mean0.381-0.384=-0.003
σ0.001-0.008=-0.007
min0.379-0.380=-0.000
max0.382-0.398=-0.016
iters=5
new-facts=1
prior-facts=6402
mean1933.225-1932.318=0.907
σ0.020-0.006=0.014
min1933.197-1932.309=0.888
max1933.245-1932.324=0.921
mean2770.000-2748.000=22.000
σ0.000
min2770.000-2748.000=22.000
max2770.000-2748.000=22.000
mean3.079-3.045=0.034
σ0.126-0.074=0.052
min2.934-2.961=-0.027
max3.262-3.148=0.114
iters=5
new-facts=6402
prior-facts=1
mean4756.925-4752.976=3.949
σ7.607-1.018=6.588
min4753.439-4752.028=1.411
max4770.532-4754.706=15.825
mean2770.000-2748.000=22.000
σ0.000
min2770.000-2748.000=22.000
max2770.000-2748.000=22.000
mean8.680-8.638=0.042
σ0.414-0.460=-0.046
min8.041-7.887=0.154
max9.121-9.015=0.107
iters=5
new-facts=6402
prior-facts=6402
mean4944.454-4943.558=0.896
σ0.018-0.015=0.004
min4944.434-4943.541=0.893
max4944.473-4943.574=0.898
mean3025.000-2989.600=35.400
σ318.225-221.785=96.439
min2770.000-2748.000=22.000
max3510.000-3312.000=198.000
mean8.459-8.520=-0.062
σ0.135-0.087=0.048
min8.290-8.433=-0.143
max8.662-8.641=0.022

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.983-0.999=-0.015
σ0.138-0.141=-0.003
min0.919-0.935=-0.015
max1.229-1.251=-0.022

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.330-468.649=-0.320
σ574.227-574.912=-0.686
min181.201-181.182=0.019
max1329.670-1331.018=-1.348
mean88.250
σ8.500
min84.000
max101.000
mean2770.000-2748.000=22.000
σ0.000
min2770.000-2748.000=22.000
max2770.000-2748.000=22.000
mean0.448-0.569=-0.121
σ0.306-0.546=-0.240
min0.293-0.288=0.005
max0.907-1.388=-0.481
policies=20
mean1812.379-1812.189=0.190
σ0.384-0.394=-0.010
min1812.104-1811.921=0.183
max1812.942-1812.771=0.170
mean840.000
σ0.000
min840.000
max840.000
mean2770.000-2748.000=22.000
σ0.000
min2770.000-2748.000=22.000
max2770.000-2748.000=22.000
mean2.885-2.853=0.032
σ0.006-0.017=-0.011
min2.881-2.833=0.048
max2.895-2.874=0.021
policies=200
mean18129.150-18129.011=0.140
σ0.485-0.679=-0.194
min18128.828-18128.244=0.584
max18129.858-18129.895=-0.037
mean8400.000
σ0.000
min8400.000
max8400.000
mean2770.000-2748.000=22.000
σ0.000
min2770.000-2748.000=22.000
max2770.000-2748.000=22.000
mean28.430-28.635=-0.205
σ0.149-0.060=0.090
min28.284-28.562=-0.278
max28.588-28.707=-0.118