Compare commits

Home / Compare e2c6be64 .. 8e5cc5ff

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.965-35.966=-0.001
σ0.104-0.103=0.001
min35.920-35.923=-0.003
max36.260-36.259=0.001
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.074-0.078=-0.004
σ0.004-0.005=-0.000
min0.070-0.074=-0.004
max0.081-0.085=-0.004
cache=y
dps=1
iters=10
policies=100
mean26.209-26.209=-0.000
σ0.004-0.005=-0.002
min26.204-26.202=0.002
max26.216-26.219=-0.003
mean412.000-413.000=-1.000
σ0.000
min412.000-413.000=-1.000
max412.000-413.000=-1.000
mean0.061-0.061=-0.000
σ0.002-0.003=-0.001
min0.059-0.059=0.000
max0.068-0.070=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.314-1756.315=-0.001
σ0.369-0.368=0.002
min1755.739-1755.741=-0.002
max1756.908-1756.909=-0.001
mean1647.700-1658.100=-10.400
σ625.175-632.614=-7.439
min609.000-612.000=-3.000
max2634.000-2731.000=-97.000
mean2.394-2.375=0.020
σ0.118-0.135=-0.017
min2.232-2.259=-0.027
max2.751-2.823=-0.072

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.836-278.844=-0.008
σ0.017-0.010=0.007
min278.808-278.832=-0.024
max278.848-278.857=-0.008
mean2634.000-2731.000=-97.000
σ0.000
min2634.000-2731.000=-97.000
max2634.000-2731.000=-97.000
mean0.410-0.409=0.001
σ0.006-0.001=0.004
min0.406-0.407=-0.002
max0.420-0.410=0.009
iters=5
new-facts=1
prior-facts=6402
mean2268.895-2268.900=-0.005
σ0.008-0.019=-0.010
min2268.884-2268.873=0.011
max2268.903-2268.922=-0.019
mean2634.000-2731.000=-97.000
σ0.000
min2634.000-2731.000=-97.000
max2634.000-2731.000=-97.000
mean3.122-3.207=-0.086
σ0.216-0.168=0.048
min2.914-2.919=-0.005
max3.433-3.352=0.081
iters=5
new-facts=6402
prior-facts=1
mean4954.128-4954.042=0.086
σ0.941-1.057=-0.116
min4953.329-4953.240=0.088
max4955.760-4955.826=-0.066
mean2634.000-2731.000=-97.000
σ0.000
min2634.000-2731.000=-97.000
max2634.000-2731.000=-97.000
mean8.138-8.046=0.093
σ0.276-0.392=-0.116
min7.856-7.794=0.062
max8.438-8.739=-0.300
iters=5
new-facts=6402
prior-facts=6402
mean5168.750-5168.748=0.002
σ0.215-0.210=0.005
min5168.392-5168.403=-0.011
max5168.934-5168.935=-0.001
mean3420.000-3365.400=54.600
σ500.785-410.562=90.223
min2835.000-2965.000=-130.000
max4166.000-3785.000=381.000
mean9.349-9.201=0.149
σ0.527-0.568=-0.040
min8.760-8.540=0.220
max10.118-9.813=0.305

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.000=0.084
σ0.227-0.067=0.161
min0.945-0.943=0.002
max1.480-1.073=0.408

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.361-460.358=0.003
σ572.656-572.652=0.004
min174.023-174.024=-0.001
max1319.344-1319.335=0.009
mean79.500
σ7.000
min76.000
max90.000
mean2634.000-2731.000=-97.000
σ0.000
min2634.000-2731.000=-97.000
max2634.000-2731.000=-97.000
mean0.562-0.552=0.011
σ0.572-0.556=0.016
min0.266-0.268=-0.002
max1.420-1.386=0.034
policies=20
mean1740.497-1740.490=0.007
σ0.317-0.322=-0.005
min1740.290-1740.295=-0.006
max1740.969-1740.971=-0.003
mean760.000
σ0.000
min760.000
max760.000
mean2634.000-2731.000=-97.000
σ0.000
min2634.000-2731.000=-97.000
max2634.000-2731.000=-97.000
mean2.682-2.691=-0.009
σ0.007-0.011=-0.004
min2.672-2.676=-0.004
max2.688-2.702=-0.013
policies=200
mean17411.839-17411.897=-0.058
σ0.598-0.536=0.062
min17411.502-17411.546=-0.044
max17412.735-17412.694=0.041
mean7600.000
σ0.000
min7600.000
max7600.000
mean2634.000-2731.000=-97.000
σ0.000
min2634.000-2731.000=-97.000
max2634.000-2731.000=-97.000
mean27.095-27.063=0.032
σ0.050-0.075=-0.024
min27.029-26.997=0.032
max27.152-27.170=-0.019