Compare commits

Home / Compare 1d20143a .. 658bf476

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.726=0.001
σ0.616-0.685=-0.069
min35.924-35.925=-0.000
max37.218-37.523=-0.305
mean4126.000-4009.000=117.000
σ0.000
min4126.000-4009.000=117.000
max4126.000-4009.000=117.000
mean0.074-0.075=-0.001
σ0.001-0.001=-0.000
min0.073-0.074=-0.001
max0.076-0.076=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.711-26.711=0.000
σ0.645-0.645=-0.001
min26.210-26.206=0.004
max27.465-27.466=-0.001
mean4126.000-4009.000=117.000
σ0.000
min4126.000-4009.000=117.000
max4126.000-4009.000=117.000
mean0.060-0.060=-0.000
σ0.001-0.001=-0.000
min0.059-0.059=-0.000
max0.061-0.061=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.359-1756.357=0.002
σ0.374-0.373=0.000
min1755.788-1755.790=-0.002
max1756.955-1756.956=-0.002
mean1651.600-1654.800=-3.200
σ626.452-627.590=-1.138
min678.000-681.000=-3.000
max2598.000-2604.000=-6.000
mean2.265-2.272=-0.007
σ0.136-0.107=0.029
min2.113-2.137=-0.024
max2.649-2.549=0.100

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.675-278.674=0.001
σ0.015-0.007=0.008
min278.659-278.666=-0.007
max278.696-278.682=0.014
mean2598.000-2604.000=-6.000
σ0.000
min2598.000-2604.000=-6.000
max2598.000-2604.000=-6.000
mean0.417-0.418=-0.001
σ0.001-0.001=-0.000
min0.416-0.417=-0.001
max0.418-0.419=-0.001
iters=5
new-facts=1
prior-facts=6402
mean2268.852-2268.845=0.007
σ0.004-0.004=-0.000
min2268.849-2268.839=0.011
max2268.858-2268.849=0.009
mean2598.000-2604.000=-6.000
σ0.000
min2598.000-2604.000=-6.000
max2598.000-2604.000=-6.000
mean3.188-2.934=0.255
σ0.297-0.069=0.228
min2.882-2.863=0.019
max3.582-3.046=0.537
iters=5
new-facts=6402
prior-facts=1
mean4952.188-4952.299=-0.111
σ0.945-0.881=0.064
min4951.346-4951.754=-0.408
max4953.815-4953.863=-0.048
mean2598.000-2604.000=-6.000
σ0.000
min2598.000-2604.000=-6.000
max2598.000-2604.000=-6.000
mean8.064-8.217=-0.152
σ0.280-0.481=-0.201
min7.694-7.847=-0.152
max8.470-8.932=-0.462
iters=5
new-facts=6402
prior-facts=6402
mean5166.984-5167.055=-0.071
σ0.158-0.010=0.148
min5166.701-5167.047=-0.346
max5167.074-5167.072=0.003
mean3368.800-3403.600=-34.800
σ526.740-479.802=46.938
min2899.000-2746.000=153.000
max4126.000-4009.000=117.000
mean9.353-9.201=0.153
σ0.095-0.186=-0.091
min9.188-8.970=0.218
max9.429-9.418=0.012

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.052-1.034=0.018
σ0.127-0.135=-0.008
min0.932-0.940=-0.008
max1.246-1.256=-0.010

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.253-460.253=0.000
σ572.607-572.608=-0.001
min173.947-173.947=0.000
max1319.163-1319.165=-0.002
mean79.500
σ7.000
min76.000
max90.000
mean436.000-435.000=1.000
σ0.000
min436.000-435.000=1.000
max436.000-435.000=1.000
mean0.553-0.537=0.016
σ0.555-0.524=0.032
min0.272-0.273=-0.000
max1.386-1.322=0.064
policies=20
mean1739.988-1740.000=-0.012
σ0.334-0.336=-0.002
min1739.745-1739.758=-0.013
max1740.478-1740.493=-0.015
mean760.000
σ0.000
min760.000
max760.000
mean444.750-445.000=-0.250
σ8.461-9.381=-0.920
min436.000-435.000=1.000
max452.000-453.000=-1.000
mean2.664-2.669=-0.005
σ0.006-0.007=-0.000
min2.659-2.662=-0.004
max2.672-2.677=-0.005
policies=200
mean17409.332-17409.265=0.066
σ0.071-0.053=0.018
min17409.247-17409.224=0.023
max17409.418-17409.343=0.076
mean7600.000
σ0.000
min7600.000
max7600.000
mean488.000-490.250=-2.250
σ2.000-3.096=-1.096
min485.000-486.000=-1.000
max489.000-493.000=-4.000
mean26.822-26.924=-0.101
σ0.090-0.138=-0.048
min26.733-26.781=-0.048
max26.947-27.113=-0.166