Compare commits

Home / Compare fc384bca .. fd08dda3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.041-31.040=0.000
σ0.049-0.048=0.001
min31.000-30.999=0.001
max31.177-31.173=0.004
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.079-0.074=0.005
σ0.003-0.005=-0.002
min0.076-0.071=0.005
max0.086-0.085=0.000
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.003-0.004=-0.001
min21.138-21.136=0.002
max21.147-21.148=-0.001
mean414.000-412.000=2.000
σ0.000
min414.000-412.000=2.000
max414.000-412.000=2.000
mean0.065-0.063=0.001
σ0.003-0.003=0.000
min0.063-0.059=0.003
max0.072-0.070=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.411-1751.413=-0.002
σ0.360-0.363=-0.003
min1750.841-1750.848=-0.007
max1751.974-1752.017=-0.043
mean1651.400-1650.150=1.250
σ644.853-622.840=22.013
min631.000-673.000=-42.000
max2855.000-2647.000=208.000
mean2.740-2.794=-0.054
σ0.216-0.191=0.025
min2.262-2.292=-0.030
max3.022-3.102=-0.081

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.787-266.780=0.007
σ0.012-0.006=0.006
min266.771-266.773=-0.002
max266.805-266.788=0.017
mean2855.000-2647.000=208.000
σ0.000
min2855.000-2647.000=208.000
max2855.000-2647.000=208.000
mean0.359-0.363=-0.004
σ0.011-0.002=0.009
min0.338-0.360=-0.022
max0.364-0.364=-0.000
iters=5
new-facts=1
prior-facts=6402
mean1927.213-1927.213=0.000
σ0.003-0.008=-0.006
min1927.210-1927.204=0.006
max1927.217-1927.226=-0.009
mean2855.000-2647.000=208.000
σ0.000
min2855.000-2647.000=208.000
max2855.000-2647.000=208.000
mean2.921-2.982=-0.061
σ0.157-0.106=0.051
min2.708-2.828=-0.119
max3.122-3.120=0.002
iters=5
new-facts=6402
prior-facts=1
mean4747.764-4747.749=0.015
σ0.826-0.801=0.025
min4747.279-4747.351=-0.072
max4749.229-4749.181=0.048
mean2855.000-2647.000=208.000
σ0.000
min2855.000-2647.000=208.000
max2855.000-2647.000=208.000
mean8.360-8.195=0.165
σ0.913-0.480=0.433
min7.569-7.753=-0.185
max9.713-8.802=0.911
iters=5
new-facts=6402
prior-facts=6402
mean4938.159-4938.162=-0.004
σ0.081-0.079=0.002
min4938.085-4938.090=-0.005
max4938.251-4938.253=-0.002
mean3078.800-2976.800=102.000
σ302.123-356.357=-54.234
min2855.000-2647.000=208.000
max3550.000-3471.000=79.000
mean8.466-8.409=0.058
σ0.235-0.080=0.155
min8.285-8.341=-0.056
max8.826-8.544=0.281

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.069-1.110=-0.042
σ0.114-0.175=-0.061
min0.929-0.947=-0.018
max1.246-1.333=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.119-465.127=-0.008
σ575.755-575.764=-0.009
min177.234-177.236=-0.002
max1328.751-1328.773=-0.022
mean79.750
σ7.500
min76.000
max91.000
mean2855.000-2647.000=208.000
σ0.000
min2855.000-2647.000=208.000
max2855.000-2647.000=208.000
mean0.441-0.561=-0.120
σ0.305-0.565=-0.260
min0.288-0.276=0.012
max0.898-1.408=-0.510
policies=20
mean1772.618-1772.613=0.005
σ0.328-0.329=-0.000
min1772.379-1772.388=-0.008
max1773.100-1773.100=0.000
mean760.000
σ0.000
min760.000
max760.000
mean2855.000-2647.000=208.000
σ0.000
min2855.000-2647.000=208.000
max2855.000-2647.000=208.000
mean2.824-2.756=0.068
σ0.006-0.019=-0.014
min2.816-2.743=0.073
max2.829-2.785=0.044
policies=200
mean17732.562-17732.665=-0.103
σ0.510-0.339=0.171
min17732.211-17732.465=-0.254
max17733.319-17733.172=0.147
mean7600.000
σ0.000
min7600.000
max7600.000
mean2855.000-2647.000=208.000
σ0.000
min2855.000-2647.000=208.000
max2855.000-2647.000=208.000
mean28.088-27.692=0.396
σ0.455-0.106=0.349
min27.654-27.557=0.097
max28.593-27.783=0.810