Compare commits

Home / Compare 35bed1aa .. 8b189c11

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-70.374=-0.001
σ0.059-0.058=0.001
min70.336-70.341=-0.005
max70.537-70.536=0.001
mean413.400-417.000=-3.600
σ0.516-0.000=0.516
min413.000-417.000=-4.000
max414.000-417.000=-3.000
mean0.157-0.159=-0.003
σ0.004-0.003=0.001
min0.151-0.156=-0.005
max0.162-0.165=-0.003
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.002-0.003=-0.001
min21.139-21.138=0.001
max21.145-21.148=-0.002
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.062-0.064=-0.001
σ0.004-0.004=0.000
min0.057-0.059=-0.002
max0.069-0.072=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.200-1752.201=-0.001
σ0.360-0.363=-0.003
min1751.632-1751.625=0.007
max1752.772-1752.788=-0.016
mean1655.200-1665.700=-10.500
σ618.978-631.467=-12.489
min658.000-686.000=-28.000
max2495.000-2791.000=-296.000
mean2.800-2.819=-0.019
σ0.188-0.143=0.044
min2.144-2.337=-0.193
max3.080-3.006=0.074

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-269.933=0.002
σ0.006-0.006=0.000
min269.929-269.926=0.002
max269.945-269.941=0.004
mean2495.000-2791.000=-296.000
σ0.000
min2495.000-2791.000=-296.000
max2495.000-2791.000=-296.000
mean0.384-0.377=0.007
σ0.006-0.009=-0.004
min0.380-0.370=0.010
max0.393-0.392=0.002
iters=5
new-facts=1
prior-facts=6402
mean1930.384-1930.387=-0.003
σ0.016-0.009=0.007
min1930.364-1930.377=-0.013
max1930.400-1930.394=0.005
mean2495.000-2791.000=-296.000
σ0.000
min2495.000-2791.000=-296.000
max2495.000-2791.000=-296.000
mean2.523-2.670=-0.147
σ0.098-0.176=-0.078
min2.452-2.473=-0.021
max2.693-2.904=-0.211
iters=5
new-facts=6402
prior-facts=1
mean4750.725-4750.879=-0.154
σ0.903-0.862=0.040
min4750.022-4750.355=-0.334
max4752.286-4752.411=-0.125
mean2495.000-2791.000=-296.000
σ0.000
min2495.000-2791.000=-296.000
max2495.000-2791.000=-296.000
mean8.680-8.481=0.199
σ0.291-0.457=-0.166
min8.384-7.862=0.521
max9.087-9.020=0.066
iters=5
new-facts=6402
prior-facts=6402
mean4941.330-4941.198=0.133
σ0.082-0.190=-0.108
min4941.267-4940.937=0.330
max4941.424-4941.421=0.003
mean2979.000-3086.400=-107.400
σ263.662-330.262=-66.600
min2635.000-2791.000=-156.000
max3315.000-3558.000=-243.000
mean8.415-8.814=-0.398
σ0.042-0.326=-0.284
min8.372-8.602=-0.231
max8.477-9.391=-0.914

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.663-1.060=0.603
σ0.168-0.124=0.044
min1.478-0.942=0.536
max1.844-1.246=0.598

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.910-465.917=-0.007
σ575.771-575.780=-0.009
min178.022-178.023=-0.001
max1329.567-1329.587=-0.020
mean81.750
σ7.500
min78.000
max93.000
mean2495.000-2791.000=-296.000
σ0.000
min2495.000-2791.000=-296.000
max2495.000-2791.000=-296.000
mean0.568-0.442=0.125
σ0.573-0.306=0.268
min0.275-0.287=-0.012
max1.428-0.901=0.527
policies=20
mean1780.458-1780.525=-0.066
σ0.345-0.370=-0.024
min1780.231-1780.267=-0.036
max1780.970-1781.068=-0.098
mean780.000
σ0.000
min780.000
max780.000
mean2495.000-2791.000=-296.000
σ0.000
min2495.000-2791.000=-296.000
max2495.000-2791.000=-296.000
mean2.778-2.855=-0.077
σ0.016-0.097=-0.081
min2.759-2.765=-0.006
max2.798-2.987=-0.188
policies=200
mean17811.508-17811.506=0.002
σ0.476-0.495=-0.019
min17811.235-17811.211=0.024
max17812.221-17812.245=-0.024
mean7800.000
σ0.000
min7800.000
max7800.000
mean2495.000-2791.000=-296.000
σ0.000
min2495.000-2791.000=-296.000
max2495.000-2791.000=-296.000
mean27.808-27.889=-0.081
σ0.075-0.144=-0.069
min27.708-27.770=-0.063
max27.888-28.098=-0.210