Compare commits

Home / Compare e7d4cfa3 .. 0c80b7be

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.566-70.566=0.000
σ0.045-0.044=0.000
min70.540-70.540=-0.000
max70.689-70.690=-0.000
mean412.200-416.000=-3.800
σ0.422-0.000=0.422
min412.000-416.000=-4.000
max413.000-416.000=-3.000
mean0.157-0.158=-0.001
σ0.005-0.004=0.000
min0.150-0.150=0.001
max0.163-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.287-21.287=0.001
σ0.003-0.004=-0.001
min21.282-21.282=0.000
max21.291-21.292=-0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.062-0.062=0.000
σ0.004-0.004=-0.000
min0.059-0.059=0.001
max0.071-0.069=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1753.655-1753.655=-0.000
σ0.360-0.361=-0.001
min1753.085-1753.084=0.001
max1754.238-1754.239=-0.000
mean1654.800-1654.150=0.650
σ622.487-633.447=-10.960
min667.000-635.000=32.000
max2658.000-2767.000=-109.000
mean2.830-2.837=-0.007
σ0.155-0.130=0.024
min2.373-2.550=-0.177
max3.040-2.990=0.050

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean272.099-272.096=0.003
σ0.007-0.004=0.003
min272.090-272.092=-0.001
max272.109-272.101=0.008
mean2658.000-2767.000=-109.000
σ0.000
min2658.000-2767.000=-109.000
max2658.000-2767.000=-109.000
mean0.394-0.392=0.002
σ0.014-0.009=0.005
min0.379-0.382=-0.003
max0.412-0.399=0.013
iters=5
new-facts=1
prior-facts=6402
mean1932.514-1932.525=-0.011
σ0.006-0.008=-0.001
min1932.506-1932.519=-0.012
max1932.523-1932.538=-0.015
mean2658.000-2767.000=-109.000
σ0.000
min2658.000-2767.000=-109.000
max2658.000-2767.000=-109.000
mean2.950-2.832=0.118
σ0.243-0.238=0.005
min2.556-2.474=0.083
max3.181-3.082=0.099
iters=5
new-facts=6402
prior-facts=1
mean4753.278-4753.299=-0.021
σ0.842-0.867=-0.024
min4752.844-4752.780=0.063
max4754.782-4754.840=-0.059
mean2658.000-2767.000=-109.000
σ0.000
min2658.000-2767.000=-109.000
max2658.000-2767.000=-109.000
mean8.441-8.292=0.148
σ0.363-0.520=-0.157
min7.822-7.600=0.222
max8.788-8.948=-0.160
iters=5
new-facts=6402
prior-facts=6402
mean4943.717-4943.648=0.070
σ0.018-0.163=-0.145
min4943.694-4943.358=0.337
max4943.736-4943.740=-0.004
mean3035.400-3053.600=-18.200
σ290.578-231.970=58.607
min2658.000-2767.000=-109.000
max3417.000-3375.000=42.000
mean8.612-8.596=0.016
σ0.149-0.155=-0.007
min8.428-8.434=-0.006
max8.798-8.842=-0.044

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.110-1.057=0.053
σ0.130-0.124=0.006
min0.936-0.944=-0.009
max1.240-1.247=-0.007

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.292-472.292=-0.001
σ575.933-575.917=0.016
min184.320-184.331=-0.011
max1336.190-1336.168=0.023
mean88.250
σ8.500
min84.000
max101.000
mean2658.000-2767.000=-109.000
σ0.000
min2658.000-2767.000=-109.000
max2658.000-2767.000=-109.000
mean0.569-0.491=0.078
σ0.563-0.382=0.181
min0.286-0.297=-0.011
max1.414-1.063=0.351
policies=20
mean1843.558-1843.597=-0.039
σ0.381-0.358=0.023
min1843.301-1843.334=-0.033
max1844.121-1844.108=0.013
mean840.000
σ0.000
min840.000
max840.000
mean2658.000-2767.000=-109.000
σ0.000
min2658.000-2767.000=-109.000
max2658.000-2767.000=-109.000
mean2.884-2.958=-0.075
σ0.030-0.116=-0.086
min2.861-2.872=-0.012
max2.928-3.120=-0.192
policies=200
mean18442.216-18442.185=0.031
σ0.463-0.527=-0.064
min18441.953-18441.895=0.058
max18442.909-18442.975=-0.066
mean8400.000
σ0.000
min8400.000
max8400.000
mean2658.000-2767.000=-109.000
σ0.000
min2658.000-2767.000=-109.000
max2658.000-2767.000=-109.000
mean29.023-29.006=0.017
σ0.104-0.084=0.020
min28.910-28.889=0.021
max29.161-29.074=0.086