Compare commits

Home / Compare 28fc668c .. d60b1b22

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.706-53.705=0.001
σ0.362-0.363=-0.001
min53.575-53.574=0.002
max54.737-54.739=-0.002
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.140-0.138=0.002
σ0.004-0.003=0.001
min0.135-0.136=-0.001
max0.146-0.143=0.002
cache=y
dps=1
iters=10
policies=100
mean42.979-42.978=0.001
σ0.006-0.006=-0.001
min42.971-42.966=0.005
max42.987-42.986=0.001
mean417.000-412.000=5.000
σ0.000
min417.000-412.000=5.000
max417.000-412.000=5.000
mean0.120-0.119=0.001
σ0.004-0.004=-0.000
min0.114-0.113=0.001
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.895-994.901=-0.006
σ1.198-1.201=-0.002
min994.363-994.373=-0.009
max999.927-999.943=-0.017
mean1061.100-1058.650=2.450
σ316.861-321.900=-5.039
min601.000-563.000=38.000
max1621.000-1622.000=-1.000
mean1.446-1.446=-0.000
σ0.099-0.078=0.021
min1.245-1.380=-0.135
max1.679-1.645=0.034

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.311-297.308=0.003
σ0.007-0.017=-0.010
min297.300-297.284=0.016
max297.320-297.332=-0.012
mean1621.000-1622.000=-1.000
σ0.000
min1621.000-1622.000=-1.000
max1621.000-1622.000=-1.000
mean0.386-0.394=-0.008
σ0.001-0.014=-0.013
min0.385-0.384=0.001
max0.388-0.418=-0.030
iters=5
new-facts=1
prior-facts=6402
mean1298.682-1298.699=-0.016
σ0.077-0.054=0.022
min1298.547-1298.607=-0.060
max1298.734-1298.736=-0.003
mean1621.000-1622.000=-1.000
σ0.000
min1621.000-1622.000=-1.000
max1621.000-1622.000=-1.000
mean2.011-1.868=0.144
σ0.097-0.031=0.065
min1.852-1.839=0.013
max2.112-1.908=0.204
iters=5
new-facts=6402
prior-facts=1
mean1718.876-1718.865=0.011
σ6.952-6.932=0.020
min1715.583-1715.550=0.033
max1731.308-1731.259=0.049
mean1621.000-1622.000=-1.000
σ0.000
min1621.000-1622.000=-1.000
max1621.000-1622.000=-1.000
mean3.055-3.068=-0.014
σ0.489-0.491=-0.002
min2.609-2.412=0.197
max3.820-3.571=0.249
iters=5
new-facts=6402
prior-facts=6402
mean1981.620-1981.591=0.029
σ0.015-0.048=-0.033
min1981.604-1981.513=0.091
max1981.640-1981.645=-0.004
mean1855.000-1817.200=37.800
σ215.206-203.599=11.606
min1621.000-1622.000=-1.000
max2135.000-2110.000=25.000
mean3.264-3.352=-0.088
σ0.095-0.398=-0.303
min3.187-3.096=0.090
max3.387-4.059=-0.672

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.279-1.209=0.070
σ0.338-0.335=0.002
min0.948-0.901=0.047
max1.659-1.717=-0.059

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.371-440.369=0.002
σ572.880-572.883=-0.003
min153.925-153.921=0.004
max1299.691-1299.694=-0.003
mean94.250
σ8.500
min90.000
max107.000
mean1621.000-1622.000=-1.000
σ0.000
min1621.000-1622.000=-1.000
max1621.000-1622.000=-1.000
mean0.540-0.526=0.014
σ0.549-0.535=0.013
min0.263-0.257=0.006
max1.363-1.329=0.034
policies=20
mean1539.496-1539.520=-0.024
σ0.303-0.310=-0.007
min1539.301-1539.328=-0.027
max1539.947-1539.982=-0.034
mean900.000
σ0.000
min900.000
max900.000
mean1621.000-1622.000=-1.000
σ0.000
min1621.000-1622.000=-1.000
max1621.000-1622.000=-1.000
mean2.568-2.579=-0.012
σ0.013-0.025=-0.012
min2.556-2.556=0.001
max2.583-2.610=-0.027
policies=200
mean15403.100-15403.105=-0.006
σ0.068-0.054=0.014
min15403.006-15403.041=-0.035
max15403.155-15403.152=0.003
mean9000.000
σ0.000
min9000.000
max9000.000
mean1621.000-1622.000=-1.000
σ0.000
min1621.000-1622.000=-1.000
max1621.000-1622.000=-1.000
mean25.952-25.844=0.107
σ0.136-0.191=-0.054
min25.782-25.627=0.155
max26.065-26.075=-0.010