Compare commits

Home / Compare 932980cd .. ecd05568

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.702-70.700=0.002
σ0.046-0.047=-0.001
min70.669-70.673=-0.004
max70.827-70.832=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.159-0.152=0.008
σ0.005-0.011=-0.006
min0.152-0.126=0.026
max0.166-0.165=0.001
cache=y
dps=1
iters=10
policies=100
mean21.407-21.407=0.000
σ0.002-0.001=0.001
min21.404-21.405=-0.002
max21.411-21.409=0.002
mean415.000-415.800=-0.800
σ0.000-0.422=-0.422
min415.000
max415.000-416.000=-1.000
mean0.063-0.053=0.010
σ0.004-0.004=0.000
min0.059-0.050=0.009
max0.072-0.061=0.011

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.928-1754.932=-0.004
σ0.361-0.363=-0.002
min1754.359-1754.367=-0.008
max1755.510-1755.529=-0.019
mean1669.000-1667.500=1.500
σ621.251-620.926=0.325
min626.000-625.000=1.000
max2507.000-2504.000=3.000
mean2.825-2.795=0.030
σ0.156-0.186=-0.030
min2.352-2.178=0.175
max3.062-3.034=0.028

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.789-272.756=0.033
σ0.005-0.008=-0.003
min272.784-272.744=0.040
max272.798-272.766=0.032
mean2507.000-2504.000=3.000
σ0.000
min2507.000-2504.000=3.000
max2507.000-2504.000=3.000
mean0.379-0.383=-0.004
σ0.001-0.010=-0.009
min0.378-0.371=0.007
max0.381-0.397=-0.017
iters=5
new-facts=1
prior-facts=6402
mean1933.225-1933.158=0.067
σ0.016-0.017=-0.001
min1933.202-1933.130=0.073
max1933.243-1933.177=0.066
mean2507.000-2504.000=3.000
σ0.000
min2507.000-2504.000=3.000
max2507.000-2504.000=3.000
mean3.192-3.070=0.122
σ0.161-0.214=-0.053
min3.039-2.771=0.268
max3.398-3.373=0.025
iters=5
new-facts=6402
prior-facts=1
mean4756.984-4756.813=0.171
σ7.543-7.653=-0.110
min4753.586-4753.000=0.586
max4770.478-4770.497=-0.020
mean2507.000-2504.000=3.000
σ0.000
min2507.000-2504.000=3.000
max2507.000-2504.000=3.000
mean8.382-8.513=-0.131
σ0.226-0.427=-0.201
min7.994-7.843=0.150
max8.576-9.034=-0.457
iters=5
new-facts=6402
prior-facts=6402
mean4944.307-4944.398=-0.091
σ0.197-0.025=0.172
min4944.078-4944.363=-0.285
max4944.462-4944.423=0.038
mean2976.600-2961.400=15.200
σ394.871-402.498=-7.626
min2507.000-2504.000=3.000
max3517.000-3479.000=38.000
mean8.455-8.495=-0.040
σ0.086-0.086=0.000
min8.385-8.408=-0.023
max8.590-8.616=-0.026

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.570-1.620=-0.050
σ0.206-0.274=-0.068
min1.216-1.223=-0.006
max1.739-1.842=-0.104

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.317-468.319=-0.002
σ574.259-574.258=0.001
min181.183-181.187=-0.004
max1329.705-1329.706=-0.001
mean88.250
σ8.500
min84.000
max101.000
mean2507.000-2504.000=3.000
σ0.000
min2507.000-2504.000=3.000
max2507.000-2504.000=3.000
mean0.543-0.560=-0.018
σ0.516-0.548=-0.032
min0.281-0.285=-0.003
max1.316-1.382=-0.066
policies=20
mean1812.143-1812.181=-0.038
σ0.378-0.386=-0.008
min1811.891-1811.932=-0.040
max1812.702-1812.753=-0.051
mean840.000
σ0.000
min840.000
max840.000
mean2507.000-2504.000=3.000
σ0.000
min2507.000-2504.000=3.000
max2507.000-2504.000=3.000
mean2.826-2.825=0.001
σ0.020-0.010=0.010
min2.808-2.812=-0.004
max2.855-2.836=0.019
policies=200
mean18128.832-18128.905=-0.073
σ0.622-0.629=-0.008
min18128.431-18128.495=-0.064
max18129.746-18129.842=-0.096
mean8400.000
σ0.000
min8400.000
max8400.000
mean2507.000-2504.000=3.000
σ0.000
min2507.000-2504.000=3.000
max2507.000-2504.000=3.000
mean28.343-28.423=-0.080
σ0.099-0.009=0.090
min28.220-28.415=-0.195
max28.463-28.435=0.028