Compare commits

Home / Compare 513d038b .. ced120ce

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.042-31.041=0.001
σ0.048-0.049=-0.001
min31.001-31.008=-0.007
max31.175-31.178=-0.003
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.079-0.080=-0.001
σ0.003-0.003=0.000
min0.076-0.077=-0.001
max0.086-0.086=-0.001
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.002-0.003=-0.001
min21.138-21.138=0.000
max21.144-21.150=-0.006
mean415.000-411.000=4.000
σ0.000
min415.000-411.000=4.000
max415.000-411.000=4.000
mean0.062-0.064=-0.001
σ0.004-0.005=-0.001
min0.058-0.058=0.000
max0.070-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.414-1751.413=0.000
σ0.362-0.363=-0.001
min1750.842-1750.845=-0.003
max1751.986-1752.001=-0.015
mean1658.300-1653.900=4.400
σ645.951-645.570=0.381
min629.000-631.000=-2.000
max2860.000-2850.000=10.000
mean2.829-2.857=-0.028
σ0.185-0.163=0.022
min2.327-2.407=-0.080
max3.003-3.077=-0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.782-266.782=0.000
σ0.011-0.018=-0.007
min266.773-266.751=0.022
max266.798-266.798=-0.000
mean2860.000-2850.000=10.000
σ0.000
min2860.000-2850.000=10.000
max2860.000-2850.000=10.000
mean0.365-0.371=-0.006
σ0.002-0.009=-0.007
min0.364-0.361=0.003
max0.368-0.380=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1927.213-1927.220=-0.007
σ0.005-0.015=-0.011
min1927.205-1927.201=0.004
max1927.218-1927.239=-0.021
mean2860.000-2850.000=10.000
σ0.000
min2860.000-2850.000=10.000
max2860.000-2850.000=10.000
mean2.975-2.843=0.131
σ0.326-0.196=0.130
min2.454-2.617=-0.163
max3.328-3.076=0.252
iters=5
new-facts=6402
prior-facts=1
mean4747.638-4747.663=-0.025
σ0.907-0.851=0.056
min4746.769-4746.856=-0.087
max4749.181-4749.109=0.073
mean2860.000-2850.000=10.000
σ0.000
min2860.000-2850.000=10.000
max2860.000-2850.000=10.000
mean8.298-8.078=0.221
σ0.497-0.364=0.133
min7.681-7.675=0.006
max8.908-8.652=0.256
iters=5
new-facts=6402
prior-facts=6402
mean4938.173-4938.165=0.008
σ0.086-0.088=-0.002
min4938.110-4938.089=0.021
max4938.272-4938.267=0.005
mean3047.800-3053.000=-5.200
σ194.495-256.679=-62.184
min2860.000-2850.000=10.000
max3323.000-3434.000=-111.000
mean8.726-8.418=0.308
σ0.423-0.119=0.304
min8.382-8.289=0.093
max9.451-8.586=0.864

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.122-1.029=0.093
σ0.105-0.139=-0.034
min1.056-0.931=0.124
max1.308-1.254=0.053

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.121-465.123=-0.002
σ575.764-575.755=0.010
min177.231-177.237=-0.006
max1328.768-1328.755=0.013
mean79.750
σ7.500
min76.000
max91.000
mean2860.000-2850.000=10.000
σ0.000
min2860.000-2850.000=10.000
max2860.000-2850.000=10.000
mean0.443-0.440=0.003
σ0.308-0.306=0.002
min0.285-0.284=0.001
max0.905-0.899=0.006
policies=20
mean1772.625-1772.630=-0.005
σ0.338-0.333=0.005
min1772.374-1772.394=-0.021
max1773.118-1773.120=-0.002
mean760.000
σ0.000
min760.000
max760.000
mean2860.000-2850.000=10.000
σ0.000
min2860.000-2850.000=10.000
max2860.000-2850.000=10.000
mean2.844-2.831=0.013
σ0.016-0.013=0.003
min2.833-2.817=0.016
max2.868-2.848=0.019
policies=200
mean17732.577-17732.541=0.036
σ0.438-0.425=0.013
min17732.281-17732.272=0.008
max17733.226-17733.174=0.052
mean7600.000
σ0.000
min7600.000
max7600.000
mean2860.000-2850.000=10.000
σ0.000
min2860.000-2850.000=10.000
max2860.000-2850.000=10.000
mean28.222-28.140=0.082
σ0.502-0.435=0.067
min27.638-27.642=-0.004
max28.660-28.523=0.137