Compare commits

Home / Compare 4fa314be .. 0c4fa95a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.783-70.782=0.001
σ0.047-0.047=-0.000
min70.753-70.750=0.003
max70.913-70.911=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.162-0.160=0.002
σ0.008-0.003=0.005
min0.153-0.158=-0.005
max0.180-0.165=0.015
cache=y
dps=1
iters=10
policies=100
mean21.493-21.493=0.001
σ0.003-0.002=0.001
min21.488-21.489=-0.001
max21.497-21.496=0.001
mean414.000
σ0.000
min414.000
max414.000
mean0.065-0.065=-0.001
σ0.004-0.003=0.001
min0.060-0.063=-0.003
max0.073-0.074=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.126-1754.126=0.001
σ0.358-0.363=-0.004
min1753.562-1753.559=0.003
max1754.689-1754.711=-0.022
mean1655.950-1664.050=-8.100
σ632.143-632.627=-0.484
min623.000-665.000=-42.000
max2708.000-2617.000=91.000
mean2.848-2.733=0.115
σ0.208-0.194=0.014
min2.269-2.300=-0.031
max3.246-2.990=0.256

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean271.950-271.951=-0.002
σ0.008-0.008=0.000
min271.942-271.943=-0.002
max271.962-271.963=-0.001
mean2708.000-2617.000=91.000
σ0.000
min2708.000-2617.000=91.000
max2708.000-2617.000=91.000
mean0.381-0.377=0.004
σ0.010-0.000=0.009
min0.374-0.376=-0.003
max0.398-0.377=0.021
iters=5
new-facts=1
prior-facts=6402
mean1932.356-1932.355=0.002
σ0.020-0.018=0.002
min1932.326-1932.332=-0.006
max1932.376-1932.377=-0.001
mean2708.000-2617.000=91.000
σ0.000
min2708.000-2617.000=91.000
max2708.000-2617.000=91.000
mean3.086-3.001=0.085
σ0.193-0.148=0.045
min2.876-2.754=0.122
max3.381-3.137=0.244
iters=5
new-facts=6402
prior-facts=1
mean4756.022-4756.084=-0.062
σ7.635-7.631=0.004
min4752.164-4752.627=-0.463
max4769.672-4769.735=-0.063
mean2708.000-2617.000=91.000
σ0.000
min2708.000-2617.000=91.000
max2708.000-2617.000=91.000
mean8.446-8.810=-0.364
σ0.372-0.218=0.154
min7.984-8.470=-0.486
max8.919-9.075=-0.156
iters=5
new-facts=6402
prior-facts=6402
mean4943.590-4943.591=-0.001
σ0.022-0.015=0.007
min4943.562-4943.574=-0.012
max4943.616-4943.606=0.010
mean2994.800-2945.600=49.200
σ332.447-347.484=-15.037
min2708.000-2617.000=91.000
max3492.000-3443.000=49.000
mean8.439-8.369=0.070
σ0.141-0.041=0.100
min8.296-8.306=-0.010
max8.624-8.408=0.216

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.976-1.193=-0.217
σ0.142-0.298=-0.157
min0.911-0.916=-0.005
max1.230-1.636=-0.407

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean467.977-467.977=-0.001
σ573.562-573.576=-0.014
min181.190-181.186=0.004
max1328.320-1328.341=-0.021
mean88.250
σ8.500
min84.000
max101.000
mean2708.000-2617.000=91.000
σ0.000
min2708.000-2617.000=91.000
max2708.000-2617.000=91.000
mean0.554-0.555=-0.001
σ0.545-0.544=0.002
min0.279-0.282=-0.003
max1.372-1.370=0.001
policies=20
mean1812.164-1812.149=0.015
σ0.385-0.381=0.004
min1811.927-1811.903=0.023
max1812.738-1812.716=0.023
mean840.000
σ0.000
min840.000
max840.000
mean2708.000-2617.000=91.000
σ0.000
min2708.000-2617.000=91.000
max2708.000-2617.000=91.000
mean2.811-2.815=-0.004
σ0.007-0.017=-0.010
min2.802-2.790=0.012
max2.818-2.828=-0.011
policies=200
mean18128.917-18129.042=-0.125
σ0.424-0.547=-0.122
min18128.563-18128.593=-0.031
max18129.533-18129.838=-0.305
mean8400.000
σ0.000
min8400.000
max8400.000
mean2708.000-2617.000=91.000
σ0.000
min2708.000-2617.000=91.000
max2708.000-2617.000=91.000
mean28.272-28.291=-0.019
σ0.114-0.137=-0.023
min28.145-28.159=-0.014
max28.376-28.480=-0.103