Compare commits

Home / Compare 8c664e3a .. f214f5eb

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.773-30.774=-0.001
σ0.046-0.046=0.000
min30.749-30.753=-0.004
max30.904
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.079-0.079=-0.000
σ0.003-0.004=-0.001
min0.076-0.076=0.000
max0.086-0.087=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.060-21.059=0.001
σ0.003-0.003=0.000
min21.057-21.055=0.002
max21.065-21.062=0.002
mean411.000-418.000=-7.000
σ0.000
min411.000-418.000=-7.000
max411.000-418.000=-7.000
mean0.064-0.063=0.002
σ0.003-0.004=-0.001
min0.062-0.059=0.004
max0.070-0.070=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.235-1751.235=0.000
σ0.364-0.361=0.003
min1750.671-1750.670=0.000
max1751.827-1751.813=0.014
mean1661.900-1652.200=9.700
σ627.285-619.608=7.677
min685.000-686.000=-1.000
max2769.000-2645.000=124.000
mean2.844-2.833=0.011
σ0.129-0.215=-0.086
min2.439-2.271=0.168
max3.060-3.185=-0.125

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean267.614-275.568=-7.953
σ17.779-0.003=17.776
min235.810-275.564=-39.754
max275.570-275.572=-0.002
mean2769.000-2645.000=124.000
σ0.000
min2769.000-2645.000=124.000
max2769.000-2645.000=124.000
mean0.380-0.390=-0.010
σ0.031-0.005=0.026
min0.326-0.387=-0.061
max0.399-0.398=0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.085-2168.097=-0.012
σ0.015-0.005=0.010
min2168.067-2168.092=-0.025
max2168.103-2168.104=-0.001
mean2769.000-2645.000=124.000
σ0.000
min2769.000-2645.000=124.000
max2769.000-2645.000=124.000
mean2.935-2.981=-0.046
σ0.097-0.211=-0.114
min2.810-2.764=0.046
max3.053-3.304=-0.251
iters=5
new-facts=6402
prior-facts=1
mean5047.909-5047.791=0.118
σ0.878-0.988=-0.110
min5047.334-5047.044=0.290
max5049.444-5049.528=-0.084
mean2769.000-2645.000=124.000
σ0.000
min2769.000-2645.000=124.000
max2769.000-2645.000=124.000
mean8.903-8.919=-0.016
σ0.507-0.490=0.016
min8.196-8.130=0.066
max9.405-9.381=0.024
iters=5
new-facts=6402
prior-facts=6402
mean5178.975-5179.046=-0.072
σ0.200-0.072=0.128
min5178.651-5178.976=-0.325
max5179.159-5179.126=0.033
mean3302.400-3223.000=79.400
σ394.037-388.196=5.841
min2769.000-2687.000=82.000
max3674.000-3710.000=-36.000
mean9.873-9.873=-0.000
σ0.212-0.295=-0.083
min9.534-9.472=0.061
max10.106-10.216=-0.110

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.056-1.197=-0.142
σ0.184-0.317=-0.133
min0.944-0.944=-0.000
max1.373-1.691=-0.318

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.203-463.204=-0.001
σ572.662-572.662=0.001
min176.869-176.871=-0.002
max1322.197-1322.196=0.000
mean77.500
σ7.000
min74.000
max88.000
mean2769.000-2645.000=124.000
σ0.000
min2769.000-2645.000=124.000
max2769.000-2645.000=124.000
mean0.440-0.548=-0.108
σ0.305-0.537=-0.233
min0.286-0.274=0.012
max0.897-1.354=-0.456
policies=20
mean1768.972-1768.959=0.014
σ0.302-0.318=-0.016
min1768.762-1768.754=0.009
max1769.421-1769.432=-0.011
mean740.000
σ0.000
min740.000
max740.000
mean2769.000-2645.000=124.000
σ0.000
min2769.000-2645.000=124.000
max2769.000-2645.000=124.000
mean2.772-2.735=0.037
σ0.080-0.019=0.061
min2.714-2.710=0.004
max2.890-2.757=0.133
policies=200
mean17696.272-17696.124=0.148
σ0.488-0.609=-0.121
min17696.005-17695.706=0.299
max17697.004-17697.029=-0.025
mean7400.000
σ0.000
min7400.000
max7400.000
mean2769.000-2645.000=124.000
σ0.000
min2769.000-2645.000=124.000
max2769.000-2645.000=124.000
mean27.577-27.620=-0.042
σ0.148-0.136=0.012
min27.413-27.491=-0.079
max27.762-27.740=0.021