Compare commits

Home / Compare 26cc8d24 .. 7ff81529

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.779-70.773=0.006
σ0.050-0.053=-0.003
min70.748-70.742=0.006
max70.919-70.920=-0.000
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.161-0.159=0.002
σ0.003-0.003=0.000
min0.158-0.156=0.002
max0.167-0.164=0.003
cache=y
dps=1
iters=10
policies=100
mean21.493-21.490=0.003
σ0.002-0.002=0.000
min21.489-21.487=0.003
max21.496-21.494=0.002
mean416.000-415.000=1.000
σ0.000
min416.000-415.000=1.000
max416.000-415.000=1.000
mean0.065-0.063=0.002
σ0.002-0.004=-0.002
min0.064-0.059=0.005
max0.071-0.073=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.881-1755.285=-3.404
σ0.363-0.361=0.002
min1751.314-1754.720=-3.406
max1752.461-1755.870=-3.409
mean1650.500-1631.250=19.250
σ642.996-595.314=47.682
min631.000-639.000=-8.000
max2846.000-2426.000=420.000
mean2.786-2.816=-0.030
σ0.185-0.179=0.006
min2.415-2.344=0.071
max3.003-3.096=-0.093

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.374-272.750=-3.376
σ0.008-0.014=-0.006
min269.367-272.737=-3.370
max269.387-272.774=-3.387
mean2846.000-2426.000=420.000
σ0.000
min2846.000-2426.000=420.000
max2846.000-2426.000=420.000
mean0.376-0.382=-0.006
σ0.004-0.004=-0.000
min0.373-0.379=-0.005
max0.382-0.388=-0.006
iters=5
new-facts=1
prior-facts=6402
mean1929.744-1933.161=-3.417
σ0.024-0.009=0.015
min1929.714-1933.150=-3.436
max1929.780-1933.174=-3.394
mean2846.000-2426.000=420.000
σ0.000
min2846.000-2426.000=420.000
max2846.000-2426.000=420.000
mean2.938-3.004=-0.066
σ0.259-0.101=0.158
min2.483-2.919=-0.437
max3.106-3.177=-0.072
iters=5
new-facts=6402
prior-facts=1
mean4750.530-4753.919=-3.388
σ0.829-0.825=0.004
min4750.114-4753.394=-3.280
max4752.012-4755.382=-3.371
mean2846.000-2426.000=420.000
σ0.000
min2846.000-2426.000=420.000
max2846.000-2426.000=420.000
mean8.321-8.502=-0.181
σ0.292-0.516=-0.224
min7.821-7.750=0.071
max8.552-9.178=-0.627
iters=5
new-facts=6402
prior-facts=6402
mean4940.980-4944.316=-3.335
σ0.024-0.168=-0.144
min4940.950-4944.018=-3.068
max4941.000-4944.410=-3.410
mean3011.800-2968.200=43.600
σ185.334-264.308=-78.974
min2846.000-2619.000=227.000
max3297.000-3308.000=-11.000
mean8.451-8.491=-0.039
σ0.084-0.050=0.034
min8.307-8.439=-0.131
max8.522-8.562=-0.041

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.015-1.760=-0.745
σ0.134-0.100=0.034
min0.925-1.623=-0.697
max1.235-1.884=-0.649

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.066-472.833=-6.766
σ574.923-574.922=0.001
min178.593-185.367=-6.774
max1328.451-1335.216=-6.765
mean86.250-88.250=-2.000
σ8.500
min82.000-84.000=-2.000
max99.000-101.000=-2.000
mean2846.000-2426.000=420.000
σ0.000
min2846.000-2426.000=420.000
max2846.000-2426.000=420.000
mean0.475-0.551=-0.076
σ0.376-0.526=-0.150
min0.282-0.287=-0.005
max1.038-1.340=-0.301
policies=20
mean1786.195-1853.987=-67.792
σ0.368-0.374=-0.006
min1785.933-1853.731=-67.797
max1786.738-1854.540=-67.801
mean820.000-840.000=-20.000
σ0.000
min820.000-840.000=-20.000
max820.000-840.000=-20.000
mean2846.000-2426.000=420.000
σ0.000
min2846.000-2426.000=420.000
max2846.000-2426.000=420.000
mean2.857-2.871=-0.014
σ0.006-0.021=-0.015
min2.850-2.854=-0.004
max2.865-2.898=-0.033
policies=200
mean17868.578-18546.567=-677.989
σ0.501-0.556=-0.054
min17868.226-18546.212=-677.986
max17869.321-18547.391=-678.070
mean8200.000-8400.000=-200.000
σ0.000
min8200.000-8400.000=-200.000
max8200.000-8400.000=-200.000
mean2846.000-2426.000=420.000
σ0.000
min2846.000-2426.000=420.000
max2846.000-2426.000=420.000
mean28.400-28.804=-0.404
σ0.400-0.084=0.316
min27.843-28.679=-0.837
max28.722-28.856=-0.134