Compare commits

Home / Compare 94a749f6 .. 673563a4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.370-70.369=0.001
σ0.058-0.058=0.001
min70.326-70.328=-0.002
max70.532-70.530=0.002
mean412.000
σ0.000
min412.000
max412.000
mean0.159-0.154=0.005
σ0.004-0.005=-0.001
min0.152-0.149=0.003
max0.163-0.162=0.001
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=0.000
σ0.002-0.003=-0.001
min21.140-21.139=0.001
max21.145-21.147=-0.002
mean413.000-412.000=1.000
σ0.000
min413.000-412.000=1.000
max413.000-412.000=1.000
mean0.063-0.062=0.000
σ0.004-0.004=0.000
min0.060-0.058=0.001
max0.072-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.197-1752.202=-0.005
σ0.363-0.361=0.002
min1751.627-1751.632=-0.005
max1752.783-1752.776=0.007
mean1654.000-1635.650=18.350
σ644.462-613.526=30.937
min617.000-625.000=-8.000
max2776.000-2465.000=311.000
mean2.792-2.748=0.044
σ0.132-0.210=-0.079
min2.460-2.283=0.177
max3.148-3.067=0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.929-269.929=0.000
σ0.006-0.004=0.001
min269.923-269.923=0.001
max269.938-269.934=0.004
mean2776.000-2465.000=311.000
σ0.000
min2776.000-2465.000=311.000
max2776.000-2465.000=311.000
mean0.373-0.374=-0.001
σ0.006-0.006=0.000
min0.370-0.371=-0.001
max0.384-0.384=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1930.393-1930.389=0.004
σ0.019-0.019=-0.000
min1930.361-1930.362=-0.001
max1930.412-1930.408=0.005
mean2776.000-2465.000=311.000
σ0.000
min2776.000-2465.000=311.000
max2776.000-2465.000=311.000
mean2.533-2.572=-0.040
σ0.152-0.145=0.007
min2.442-2.498=-0.056
max2.802-2.830=-0.028
iters=5
new-facts=6402
prior-facts=1
mean4750.842-4750.876=-0.034
σ0.797-0.820=-0.024
min4750.312-4750.255=0.057
max4752.247-4752.294=-0.047
mean2776.000-2465.000=311.000
σ0.000
min2776.000-2465.000=311.000
max2776.000-2465.000=311.000
mean8.597-8.750=-0.153
σ0.235-0.583=-0.348
min8.321-8.312=0.009
max8.947-9.748=-0.800
iters=5
new-facts=6402
prior-facts=6402
mean4941.333-4941.257=0.076
σ0.081-0.128=-0.047
min4941.268-4941.066=0.202
max4941.424-4941.427=-0.003
mean3011.600-2995.600=16.000
σ219.228-286.716=-67.488
min2776.000-2583.000=193.000
max3303.000
mean8.446-8.475=-0.030
σ0.125-0.069=0.056
min8.308-8.369=-0.062
max8.633-8.539=0.094

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.108-1.721=-0.613
σ0.078-0.187=-0.108
min1.063-1.471=-0.408
max1.247-1.918=-0.671

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.626-465.623=0.003
σ575.197-575.195=0.003
min178.023-178.022=0.001
max1328.422-1328.414=0.007
mean81.750
σ7.500
min78.000
max93.000
mean2776.000-2465.000=311.000
σ0.000
min2776.000-2465.000=311.000
max2776.000-2465.000=311.000
mean0.443-0.556=-0.112
σ0.306-0.557=-0.251
min0.285-0.275=0.010
max0.902-1.390=-0.488
policies=20
mean1780.513-1780.458=0.056
σ0.337-0.375=-0.039
min1780.281-1780.210=0.071
max1781.005-1781.015=-0.010
mean780.000
σ0.000
min780.000
max780.000
mean2776.000-2465.000=311.000
σ0.000
min2776.000-2465.000=311.000
max2776.000-2465.000=311.000
mean2.855-2.768=0.087
σ0.082-0.020=0.062
min2.758-2.745=0.013
max2.960-2.787=0.173
policies=200
mean17811.357-17811.389=-0.033
σ0.551-0.417=0.133
min17810.921-17811.104=-0.183
max17812.157-17812.007=0.150
mean7800.000
σ0.000
min7800.000
max7800.000
mean2776.000-2465.000=311.000
σ0.000
min2776.000-2465.000=311.000
max2776.000-2465.000=311.000
mean27.743-27.819=-0.076
σ0.141-0.114=0.027
min27.593-27.700=-0.107
max27.931-27.974=-0.043