Compare commits

Home / Compare 57b9d6b3 .. 46952483

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.772-30.772=0.000
σ0.044-0.049=-0.004
min30.750-30.743=0.007
max30.898-30.909=-0.011
mean412.200-415.000=-2.800
σ0.422-0.000=0.422
min412.000-415.000=-3.000
max413.000-415.000=-2.000
mean0.078-0.074=0.004
σ0.003-0.005=-0.002
min0.075-0.070=0.005
max0.084-0.085=-0.000
cache=y
dps=1
iters=10
policies=100
mean21.059-21.059=0.000
σ0.002-0.003=-0.001
min21.056-21.055=0.002
max21.061-21.063=-0.002
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.064-0.063=0.001
σ0.003-0.004=-0.001
min0.062-0.059=0.003
max0.071-0.071=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.236-1751.237=-0.002
σ0.364-0.364=0.000
min1750.664-1750.670=-0.006
max1751.825-1751.821=0.004
mean1662.050-1665.900=-3.850
σ634.090-636.535=-2.445
min680.000-681.000=-1.000
max2679.000-2704.000=-25.000
mean2.862-2.873=-0.011
σ0.127-0.131=-0.004
min2.421-2.540=-0.119
max3.038-3.032=0.006

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.567-275.564=0.003
σ0.004-0.007=-0.003
min275.562-275.557=0.004
max275.572-275.576=-0.004
mean2679.000-2704.000=-25.000
σ0.000
min2679.000-2704.000=-25.000
max2679.000-2704.000=-25.000
mean0.394-0.393=0.000
σ0.009-0.010=-0.001
min0.386-0.385=0.001
max0.403-0.404=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2168.093-2168.091=0.002
σ0.019-0.008=0.010
min2168.074-2168.077=-0.003
max2168.118-2168.098=0.020
mean2679.000-2704.000=-25.000
σ0.000
min2679.000-2704.000=-25.000
max2679.000-2704.000=-25.000
mean2.995-3.024=-0.029
σ0.198-0.196=0.002
min2.673-2.779=-0.107
max3.202-3.225=-0.023
iters=5
new-facts=6402
prior-facts=1
mean5047.911-5047.785=0.126
σ0.911-1.014=-0.103
min5047.347-5046.920=0.427
max5049.529-5049.540=-0.011
mean2679.000-2704.000=-25.000
σ0.000
min2679.000-2704.000=-25.000
max2679.000-2704.000=-25.000
mean8.746-8.766=-0.020
σ0.496-0.300=0.196
min8.132-8.351=-0.219
max9.233-9.152=0.081
iters=5
new-facts=6402
prior-facts=6402
mean5179.064-5179.041=0.023
σ0.083-0.077=0.006
min5178.986-5178.968=0.018
max5179.156-5179.129=0.027
mean3284.400-3220.600=63.800
σ407.878-379.642=28.236
min2684.000-2704.000=-20.000
max3642.000-3700.000=-58.000
mean10.179-9.884=0.295
σ0.115-0.389=-0.274
min10.024-9.433=0.592
max10.298-10.466=-0.168

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.201-1.086=0.115
σ0.251-0.133=0.117
min0.945-0.957=-0.012
max1.517-1.265=0.251

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.207=-0.002
σ572.661-572.661=0.001
min176.872-176.873=-0.001
max1322.197-1322.198=-0.001
mean77.500
σ7.000
min74.000
max88.000
mean2679.000-2704.000=-25.000
σ0.000
min2679.000-2704.000=-25.000
max2679.000-2704.000=-25.000
mean0.552-0.548=0.004
σ0.546-0.544=0.003
min0.274-0.271=0.003
max1.371-1.364=0.008
policies=20
mean1768.967-1768.971=-0.004
σ0.334-0.338=-0.004
min1768.757-1768.757=0.001
max1769.466-1769.476=-0.010
mean740.000
σ0.000
min740.000
max740.000
mean2679.000-2704.000=-25.000
σ0.000
min2679.000-2704.000=-25.000
max2679.000-2704.000=-25.000
mean2.763-2.755=0.009
σ0.073-0.017=0.056
min2.710-2.740=-0.030
max2.872-2.778=0.094
policies=200
mean17696.225-17696.241=-0.015
σ0.486-0.507=-0.021
min17695.956-17695.930=0.026
max17696.953-17696.995=-0.042
mean7400.000
σ0.000
min7400.000
max7400.000
mean2679.000-2704.000=-25.000
σ0.000
min2679.000-2704.000=-25.000
max2679.000-2704.000=-25.000
mean27.610-27.688=-0.078
σ0.114-0.142=-0.028
min27.491-27.501=-0.009
max27.720-27.801=-0.081