Compare commits

Home / Compare c7e43967 .. be8fb891

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.708-70.706=0.002
σ0.046-0.046=0.000
min70.676-70.674=0.002
max70.837-70.834=0.003
mean414.000-417.800=-3.800
σ0.000-0.422=-0.422
min414.000-417.000=-3.000
max414.000-418.000=-4.000
mean0.159-0.159=-0.000
σ0.005-0.006=-0.000
min0.151-0.145=0.006
max0.164-0.165=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.411-21.412=-0.001
σ0.003-0.004=-0.001
min21.406-21.407=-0.001
max21.415-21.419=-0.005
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.064-0.063=0.000
max0.073-0.071=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.932-1754.930=0.001
σ0.361-0.359=0.002
min1754.369-1754.366=0.003
max1755.518-1755.504=0.014
mean1651.750-1630.850=20.900
σ614.326-597.899=16.426
min623.000-645.000=-22.000
max2493.000-2419.000=74.000
mean2.781-2.809=-0.027
σ0.173-0.207=-0.034
min2.408-2.175=0.233
max3.061-3.068=-0.007

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.789-272.790=-0.001
σ0.005-0.008=-0.002
min272.784-272.783=0.000
max272.797-272.803=-0.006
mean2493.000-2419.000=74.000
σ0.000
min2493.000-2419.000=74.000
max2493.000-2419.000=74.000
mean0.381-0.378=0.003
σ0.006-0.002=0.004
min0.377-0.376=0.001
max0.391-0.380=0.011
iters=5
new-facts=1
prior-facts=6402
mean1933.230-1933.223=0.007
σ0.024-0.010=0.014
min1933.205-1933.212=-0.007
max1933.266-1933.235=0.030
mean2493.000-2419.000=74.000
σ0.000
min2493.000-2419.000=74.000
max2493.000-2419.000=74.000
mean3.026-2.980=0.045
σ0.355-0.189=0.167
min2.461-2.738=-0.276
max3.437-3.193=0.243
iters=5
new-facts=6402
prior-facts=1
mean4756.950-4756.937=0.013
σ7.553-7.572=-0.019
min4753.505-4753.480=0.025
max4770.462-4770.483=-0.021
mean2493.000-2419.000=74.000
σ0.000
min2493.000-2419.000=74.000
max2493.000-2419.000=74.000
mean8.569-8.597=-0.028
σ0.211-0.393=-0.182
min8.289-7.983=0.306
max8.780-8.972=-0.192
iters=5
new-facts=6402
prior-facts=6402
mean4944.378-4944.455=-0.076
σ0.162-0.018=0.143
min4944.091-4944.441=-0.350
max4944.478-4944.476=0.002
mean2961.200-2979.000=-17.800
σ396.983-272.838=124.145
min2493.000-2608.000=-115.000
max3515.000-3315.000=200.000
mean8.415-8.532=-0.117
σ0.163-0.084=0.079
min8.318-8.406=-0.088
max8.705-8.642=0.063

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.693-1.761=-0.068
σ0.123-0.086=0.037
min1.588-1.672=-0.085
max1.876-1.856=0.020

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean468.304-468.301=0.003
σ574.227-574.223=0.004
min181.183-181.185=-0.002
max1329.644-1329.636=0.008
mean88.250
σ8.500
min84.000
max101.000
mean2493.000-2419.000=74.000
σ0.000
min2493.000-2419.000=74.000
max2493.000-2419.000=74.000
mean0.552-0.558=-0.006
σ0.542-0.539=0.003
min0.277-0.281=-0.005
max1.364-1.367=-0.002
policies=20
mean1812.188-1812.163=0.025
σ0.384-0.382=0.002
min1811.932-1811.909=0.023
max1812.754-1812.728=0.026
mean840.000
σ0.000
min840.000
max840.000
mean2493.000-2419.000=74.000
σ0.000
min2493.000-2419.000=74.000
max2493.000-2419.000=74.000
mean2.829-2.825=0.004
σ0.028-0.019=0.008
min2.805-2.804=0.001
max2.863-2.849=0.014
policies=200
mean18128.945-18129.023=-0.078
σ0.387-0.383=0.004
min18128.659-18128.740=-0.082
max18129.501-18129.585=-0.084
mean8400.000
σ0.000
min8400.000
max8400.000
mean2493.000-2419.000=74.000
σ0.000
min2493.000-2419.000=74.000
max2493.000-2419.000=74.000
mean28.340-28.469=-0.129
σ0.083-0.030=0.053
min28.242-28.440=-0.198
max28.442-28.511=-0.069