Compare commits

Home / Compare 18ba5bbc .. 31882be2

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.978=0.002
σ0.050-0.050=0.000
min33.951-33.949=0.002
max34.117-34.117=0.000
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.083-0.080=0.002
σ0.005-0.006=-0.001
min0.076-0.075=0.001
max0.092-0.090=0.002
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=-0.001
min23.313-23.312=0.001
max23.320-23.322=-0.001
mean419.000-416.000=3.000
σ0.000
min419.000-416.000=3.000
max419.000-416.000=3.000
mean0.066-0.065=0.000
σ0.002-0.002=0.000
min0.064-0.063=0.001
max0.072-0.072=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.492-1757.487=0.005
σ0.365-0.364=0.001
min1756.923-1756.918=0.006
max1758.080-1758.077=0.003
mean1669.750-1649.550=20.200
σ626.668-639.467=-12.799
min674.000-630.000=44.000
max2611.000-2879.000=-268.000
mean2.403-2.401=0.002
σ0.114-0.098=0.016
min2.278-2.300=-0.022
max2.762-2.690=0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.632-326.638=-0.005
σ0.050-0.049=0.000
min326.544-326.551=-0.007
max326.661-326.674=-0.013
mean2611.000-2879.000=-268.000
σ0.000
min2611.000-2879.000=-268.000
max2611.000-2879.000=-268.000
mean0.428-0.426=0.003
σ0.007-0.006=0.001
min0.424-0.420=0.004
max0.441-0.433=0.007
iters=5
new-facts=1
prior-facts=6402
mean1988.796-1988.801=-0.006
σ0.022-0.014=0.008
min1988.764-1988.784=-0.020
max1988.821-1988.822=-0.001
mean2611.000-2879.000=-268.000
σ0.000
min2611.000-2879.000=-268.000
max2611.000-2879.000=-268.000
mean2.623-2.724=-0.101
σ0.173-0.117=0.056
min2.335-2.625=-0.290
max2.806-2.924=-0.118
iters=5
new-facts=6402
prior-facts=1
mean4813.646-4813.699=-0.053
σ7.724-7.741=-0.018
min4810.117-4810.118=-0.001
max4827.462-4827.546=-0.083
mean2611.000-2879.000=-268.000
σ0.000
min2611.000-2879.000=-268.000
max2611.000-2879.000=-268.000
mean8.866-8.703=0.163
σ0.321-0.711=-0.391
min8.535-7.675=0.860
max9.195-9.417=-0.223
iters=5
new-facts=6402
prior-facts=6402
mean5000.925-5001.194=-0.270
σ0.416-0.013=0.403
min5000.469-5001.179=-0.710
max5001.264-5001.205=0.059
mean2989.400-3032.400=-43.000
σ280.134-241.143=38.991
min2611.000-2879.000=-268.000
max3309.000-3430.000=-121.000
mean9.787-9.496=0.290
σ0.243-0.563=-0.320
min9.581-8.490=1.091
max10.169-9.778=0.391

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.255-1.090=0.164
σ0.332-0.246=0.086
min0.921-0.917=0.003
max1.654-1.515=0.139

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.637-464.632=0.005
σ574.790-574.765=0.026
min177.233-177.239=-0.006
max1326.823-1326.778=0.044
mean88.250
σ8.500
min84.000
max101.000
mean2611.000-2879.000=-268.000
σ0.000
min2611.000-2879.000=-268.000
max2611.000-2879.000=-268.000
mean0.549-0.435=0.114
σ0.550-0.304=0.245
min0.274-0.282=-0.008
max1.374-0.892=0.482
policies=20
mean1772.676-1772.700=-0.024
σ0.353-0.365=-0.011
min1772.435-1772.440=-0.005
max1773.201-1773.239=-0.038
mean840.000
σ0.000
min840.000
max840.000
mean2611.000-2879.000=-268.000
σ0.000
min2611.000-2879.000=-268.000
max2611.000-2879.000=-268.000
mean2.722-2.798=-0.077
σ0.007-0.008=-0.001
min2.712-2.787=-0.075
max2.726-2.806=-0.080
policies=200
mean17734.006-17733.837=0.169
σ0.525-0.540=-0.015
min17733.682-17733.433=0.248
max17734.790-17734.634=0.157
mean8400.000
σ0.000
min8400.000
max8400.000
mean2611.000-2879.000=-268.000
σ0.000
min2611.000-2879.000=-268.000
max2611.000-2879.000=-268.000
mean27.066-27.961=-0.895
σ0.545-0.387=0.158
min26.425-27.597=-1.172
max27.602-28.438=-0.836