Compare commits

Home / Compare 2798be18 .. 0f1d0f87

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.991-35.991=-0.000
σ0.103-0.105=-0.002
min35.950-35.946=0.004
max36.283-36.288=-0.005
mean3941.000-4001.000=-60.000
σ0.000
min3941.000-4001.000=-60.000
max3941.000-4001.000=-60.000
mean0.072-0.075=-0.003
σ0.003-0.001=0.002
min0.070-0.074=-0.004
max0.076-0.076=0.001
cache=y
dps=1
iters=10
policies=100
mean26.215-26.215=-0.000
σ0.002-0.003=-0.001
min26.213-26.209=0.004
max26.219-26.221=-0.002
mean3941.000-4001.000=-60.000
σ0.000
min3941.000-4001.000=-60.000
max3941.000-4001.000=-60.000
mean0.060-0.060=-0.000
σ0.001-0.001=0.000
min0.059-0.059=0.000
max0.061-0.061=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.369=-0.001
σ0.374-0.372=0.001
min1755.789-1755.795=-0.006
max1756.966-1756.972=-0.006
mean1661.150-1639.850=21.300
σ636.016-616.175=19.841
min621.000-613.000=8.000
max2691.000-2683.000=8.000
mean2.283-2.267=0.017
σ0.130-0.155=-0.025
min2.134-2.129=0.005
max2.591-2.759=-0.168

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.700-278.698=0.003
σ0.008-0.013=-0.005
min278.690-278.686=0.004
max278.709-278.719=-0.010
mean2691.000-2683.000=8.000
σ0.000
min2691.000-2683.000=8.000
max2691.000-2683.000=8.000
mean0.420-0.417=0.003
σ0.001-0.001=0.000
min0.418-0.416=0.002
max0.422-0.419=0.003
iters=5
new-facts=1
prior-facts=6402
mean2268.875-2268.861=0.014
σ0.003-0.015=-0.012
min2268.872-2268.844=0.028
max2268.880-2268.879=0.000
mean2691.000-2683.000=8.000
σ0.000
min2691.000-2683.000=8.000
max2691.000-2683.000=8.000
mean2.979-2.964=0.015
σ0.174-0.174=-0.000
min2.819-2.857=-0.038
max3.276-3.272=0.004
iters=5
new-facts=6402
prior-facts=1
mean4952.084-4952.199=-0.115
σ0.615-0.771=-0.156
min4951.695-4951.730=-0.035
max4953.177-4953.571=-0.393
mean2691.000-2683.000=8.000
σ0.000
min2691.000-2683.000=8.000
max2691.000-2683.000=8.000
mean8.051-7.873=0.178
σ0.397-0.281=0.116
min7.761-7.627=0.134
max8.690-8.347=0.344
iters=5
new-facts=6402
prior-facts=6402
mean5166.781-5166.929=-0.148
σ0.294-0.022=0.271
min5166.256-5166.914=-0.658
max5166.921-5166.969=-0.048
mean3396.600-3353.800=42.800
σ446.700-446.573=0.127
min2769.000-2831.000=-62.000
max3941.000-4001.000=-60.000
mean9.788-9.716=0.072
σ0.289-0.487=-0.198
min9.449-9.181=0.267
max10.221-10.414=-0.193

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.117-1.052=0.065
σ0.084-0.126=-0.042
min1.061-0.935=0.126
max1.266-1.248=0.018

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.261-460.262=-0.002
σ572.605-572.608=-0.003
min173.958-173.954=0.003
max1319.168-1319.174=-0.007
mean79.500
σ7.000
min76.000
max90.000
mean437.000-438.000=-1.000
σ0.000
min437.000-438.000=-1.000
max437.000-438.000=-1.000
mean0.559-0.584=-0.025
σ0.562-0.623=-0.061
min0.274-0.270=0.003
max1.402-1.519=-0.117
policies=20
mean1740.080-1740.056=0.024
σ0.340-0.314=0.027
min1739.835-1739.831=0.004
max1740.580-1740.517=0.062
mean760.000
σ0.000
min760.000
max760.000
mean447.750-446.750=1.000
σ9.743-8.461=1.282
min437.000-438.000=-1.000
max456.000-454.000=2.000
mean2.680-2.634=0.046
σ0.014-0.011=0.003
min2.666-2.622=0.044
max2.698-2.647=0.051
policies=200
mean17409.986-17410.072=-0.086
σ0.100-0.053=0.047
min17409.870-17410.013=-0.143
max17410.108-17410.139=-0.030
mean7600.000
σ0.000
min7600.000
max7600.000
mean492.250-490.500=1.750
σ3.500-2.646=0.854
min488.000-487.000=1.000
max496.000-493.000=3.000
mean26.957-26.873=0.085
σ0.081-0.106=-0.025
min26.876-26.757=0.119
max27.061-27.014=0.047