Compare commits

Home / Compare 9a6ec7ea .. 88b68fbc

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.374-31.041=39.333
σ0.057-0.050=0.007
min70.339-30.999=39.340
max70.532-31.180=39.352
mean415.000
σ0.000
min415.000
max415.000
mean0.156-0.080=0.076
σ0.004-0.003=0.001
min0.150-0.077=0.073
max0.162-0.087=0.075
cache=y
dps=1
iters=10
policies=100
mean21.143-21.143=-0.000
σ0.003-0.003=-0.000
min21.137-21.140=-0.003
max21.146-21.149=-0.004
mean415.000
σ0.000
min415.000
max415.000
mean0.063-0.062=0.002
σ0.004-0.003=0.001
min0.058-0.059=-0.002
max0.071-0.066=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1752.199-1751.410=0.789
σ0.361-0.362=-0.001
min1751.626-1750.839=0.787
max1752.767-1751.993=0.774
mean1638.500-1655.700=-17.200
σ604.582-630.484=-25.903
min644.000-622.000=22.000
max2452.000-2753.000=-301.000
mean2.780-2.757=0.023
σ0.154-0.231=-0.078
min2.452-2.171=0.281
max2.953-2.985=-0.031

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean269.935-266.783=3.153
σ0.008-0.008=0.001
min269.923-266.773=3.150
max269.945-266.791=3.154
mean2452.000-2753.000=-301.000
σ0.000
min2452.000-2753.000=-301.000
max2452.000-2753.000=-301.000
mean0.382-0.363=0.019
σ0.006-0.001=0.005
min0.378-0.362=0.016
max0.393-0.364=0.029
iters=5
new-facts=1
prior-facts=6402
mean1930.394-1927.214=3.180
σ0.016-0.009=0.008
min1930.366-1927.209=3.157
max1930.407-1927.229=3.178
mean2452.000-2753.000=-301.000
σ0.000
min2452.000-2753.000=-301.000
max2452.000-2753.000=-301.000
mean2.516-3.091=-0.574
σ0.080-0.112=-0.032
min2.459-2.967=-0.508
max2.648-3.217=-0.569
iters=5
new-facts=6402
prior-facts=1
mean4750.860-4747.734=3.126
σ0.816-0.791=0.025
min4750.315-4747.312=3.003
max4752.298-4749.145=3.153
mean2452.000-2753.000=-301.000
σ0.000
min2452.000-2753.000=-301.000
max2452.000-2753.000=-301.000
mean8.635-8.292=0.344
σ0.262-0.325=-0.064
min8.429-7.929=0.500
max9.067-8.806=0.261
iters=5
new-facts=6402
prior-facts=6402
mean4941.263-4938.162=3.101
σ0.205-0.083=0.123
min4940.926-4938.083=2.842
max4941.430-4938.257=3.173
mean3014.200-3025.800=-11.600
σ315.836-318.240=-2.404
min2606.000-2753.000=-147.000
max3415.000-3494.000=-79.000
mean8.548-8.415=0.133
σ0.196-0.124=0.072
min8.407-8.267=0.140
max8.880-8.604=0.276

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.748-1.022=0.726
σ0.098-0.140=-0.041
min1.624-0.930=0.694
max1.848-1.254=0.594

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.900-465.120=0.780
σ575.755-575.753=0.002
min178.019-177.235=0.784
max1329.532-1328.750=0.783
mean81.750-79.750=2.000
σ7.500
min78.000-76.000=2.000
max93.000-91.000=2.000
mean2452.000-2753.000=-301.000
σ0.000
min2452.000-2753.000=-301.000
max2452.000-2753.000=-301.000
mean0.566-0.561=0.004
σ0.562-0.561=0.001
min0.277-0.278=-0.001
max1.409-1.403=0.006
policies=20
mean1780.453-1772.595=7.858
σ0.365-0.319=0.046
min1780.206-1772.392=7.814
max1780.995-1773.071=7.924
mean780.000-760.000=20.000
σ0.000
min780.000-760.000=20.000
max780.000-760.000=20.000
mean2452.000-2753.000=-301.000
σ0.000
min2452.000-2753.000=-301.000
max2452.000-2753.000=-301.000
mean2.767-2.741=0.026
σ0.019-0.011=0.008
min2.744-2.725=0.019
max2.785-2.747=0.039
policies=200
mean17811.187-17732.376=78.811
σ0.440-0.599=-0.159
min17810.897-17732.056=78.841
max17811.829-17733.274=78.555
mean7800.000-7600.000=200.000
σ0.000
min7800.000-7600.000=200.000
max7800.000-7600.000=200.000
mean2452.000-2753.000=-301.000
σ0.000
min2452.000-2753.000=-301.000
max2452.000-2753.000=-301.000
mean27.813-27.702=0.111
σ0.054-0.177=-0.124
min27.765-27.505=0.260
max27.874-27.853=0.022