Compare commits

Home / Compare 990272a6 .. 2b161c7f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.727-36.727=0.000
σ0.616-0.685=-0.069
min35.924-35.931=-0.007
max37.223-37.525=-0.302
mean3985.000-3975.000=10.000
σ0.000
min3985.000-3975.000=10.000
max3985.000-3975.000=10.000
mean0.075-0.075=0.000
σ0.001-0.001=-0.000
min0.074-0.074=-0.000
max0.076-0.076=0.000
cache=y
dps=1
iters=10
policies=100
mean26.712-26.586=0.126
σ0.645-0.604=0.041
min26.206-26.207=-0.000
max27.465-27.463=0.002
mean3985.000-3975.000=10.000
σ0.000
min3985.000-3975.000=10.000
max3985.000-3975.000=10.000
mean0.060-0.060=-0.000
σ0.001-0.000=0.001
min0.059-0.060=-0.001
max0.062-0.061=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.367-1756.365=0.002
σ0.372-0.374=-0.001
min1755.796-1755.794=0.002
max1756.968-1756.963=0.005
mean1657.650-1648.700=8.950
σ627.365-617.436=9.929
min683.000-615.000=68.000
max2607.000-2643.000=-36.000
mean2.264-2.259=0.005
σ0.143-0.184=-0.041
min2.137-2.081=0.055
max2.776-2.770=0.005

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.693-278.693=-0.000
σ0.012-0.014=-0.002
min278.686-278.679=0.007
max278.714-278.717=-0.002
mean2607.000-2643.000=-36.000
σ0.000
min2607.000-2643.000=-36.000
max2607.000-2643.000=-36.000
mean0.419-0.418=0.001
σ0.001-0.002=-0.000
min0.417-0.417=0.001
max0.420-0.420=0.000
iters=5
new-facts=1
prior-facts=6402
mean2268.870-2268.866=0.004
σ0.006-0.010=-0.005
min2268.861-2268.852=0.009
max2268.876-2268.880=-0.004
mean2607.000-2643.000=-36.000
σ0.000
min2607.000-2643.000=-36.000
max2607.000-2643.000=-36.000
mean2.908-2.931=-0.022
σ0.086-0.039=0.048
min2.838-2.905=-0.068
max3.058-2.997=0.061
iters=5
new-facts=6402
prior-facts=1
mean4952.299-4952.360=-0.062
σ0.893-0.779=0.115
min4951.840-4951.979=-0.139
max4953.895-4953.752=0.143
mean2607.000-2643.000=-36.000
σ0.000
min2607.000-2643.000=-36.000
max2607.000-2643.000=-36.000
mean8.249-7.882=0.367
σ0.326-0.154=0.172
min7.805-7.750=0.055
max8.667-8.131=0.536
iters=5
new-facts=6402
prior-facts=6402
mean5167.067-5167.074=-0.007
σ0.013-0.008=0.005
min5167.052-5167.064=-0.011
max5167.088-5167.087=0.001
mean3405.000-3419.000=-14.000
σ461.474-447.247=14.227
min2769.000-2811.000=-42.000
max3985.000-3975.000=10.000
mean9.527-9.371=0.156
σ0.281-0.122=0.159
min9.074-9.251=-0.177
max9.770-9.576=0.195

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.093-1.083=0.010
σ0.161-0.112=0.050
min0.924-0.945=-0.021
max1.266-1.258=0.008

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.257-460.257=-0.000
σ572.608-572.608=0.000
min173.953-173.949=0.004
max1319.169-1319.169=0.000
mean79.500
σ7.000
min76.000
max90.000
mean437.000-436.000=1.000
σ0.000
min437.000-436.000=1.000
max437.000-436.000=1.000
mean0.555-0.499=0.056
σ0.557-0.449=0.108
min0.273-0.268=0.004
max1.391-1.174=0.217
policies=20
mean1740.034-1740.024=0.010
σ0.331-0.335=-0.004
min1739.791-1739.788=0.003
max1740.517-1740.518=-0.001
mean760.000
σ0.000
min760.000
max760.000
mean447.500-446.500=1.000
σ9.950
min437.000-436.000=1.000
max456.000-455.000=1.000
mean2.667-2.667=0.001
σ0.019-0.016=0.003
min2.647-2.644=0.003
max2.692-2.677=0.016
policies=200
mean17409.745-17409.682=0.064
σ0.110-0.156=-0.046
min17409.582-17409.540=0.041
max17409.812-17409.864=-0.051
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.500-491.750=0.750
σ1.291-2.363=-1.072
min491.000-490.000=1.000
max494.000-495.000=-1.000
mean26.940-26.899=0.041
σ0.200-0.112=0.088
min26.795-26.774=0.021
max27.226-27.041=0.185