Compare commits

Home / Compare 5980b17d .. 51205ccf

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.915-53.913=0.001
σ0.367-0.366=0.001
min53.789-53.778=0.011
max54.960-54.955=0.005
mean413.000-416.800=-3.800
σ0.000-0.422=-0.422
min413.000-416.000=-3.000
max413.000-417.000=-4.000
mean0.138-0.136=0.001
σ0.004-0.006=-0.002
min0.131-0.129=0.003
max0.143-0.145=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.141-43.142=-0.000
σ0.006-0.006=0.000
min43.131-43.132=-0.000
max43.152-43.149=0.003
mean413.000-417.000=-4.000
σ0.000
min413.000-417.000=-4.000
max413.000-417.000=-4.000
mean0.122-0.121=0.001
σ0.003-0.003=-0.000
min0.119-0.118=0.001
max0.128-0.128=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean991.815-991.815=-0.001
σ1.241-1.242=-0.001
min991.230-991.227=0.003
max997.032-997.032=-0.000
mean1063.900-1067.250=-3.350
σ315.858-314.142=1.716
min614.000-623.000=-9.000
max1636.000-1638.000=-2.000
mean1.521-1.543=-0.022
σ0.094-0.094=-0.000
min1.448-1.459=-0.012
max1.881-1.765=0.115

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.385-285.416=-0.031
σ0.009-0.012=-0.004
min285.376-285.398=-0.022
max285.396-285.430=-0.035
mean1636.000-1638.000=-2.000
σ0.000
min1636.000-1638.000=-2.000
max1636.000-1638.000=-2.000
mean0.377-0.382=-0.005
σ0.001-0.008=-0.007
min0.376-0.373=0.003
max0.378-0.389=-0.010
iters=5
new-facts=1
prior-facts=6402
mean1285.375-1285.359=0.016
σ0.135-0.090=0.045
min1285.308-1285.316=-0.009
max1285.616-1285.520=0.096
mean1636.000-1638.000=-2.000
σ0.000
min1636.000-1638.000=-2.000
max1636.000-1638.000=-2.000
mean1.879-2.061=-0.182
σ0.060-0.243=-0.184
min1.821-1.860=-0.039
max1.977-2.400=-0.423
iters=5
new-facts=6402
prior-facts=1
mean1807.704-1807.734=-0.030
σ6.992-6.993=-0.001
min1804.384-1804.327=0.057
max1820.201-1820.227=-0.027
mean1636.000-1638.000=-2.000
σ0.000
min1636.000-1638.000=-2.000
max1636.000-1638.000=-2.000
mean4.233-4.279=-0.046
σ0.231-0.336=-0.104
min3.997-3.783=0.213
max4.486-4.680=-0.194
iters=5
new-facts=6402
prior-facts=6402
mean2070.195-2070.191=0.004
σ0.012-0.011=0.001
min2070.185-2070.184=0.001
max2070.214-2070.210=0.003
mean1849.200-1860.000=-10.800
σ207.970-196.306=11.665
min1636.000-1638.000=-2.000
max2086.000
mean4.489-4.446=0.042
σ0.109-0.120=-0.011
min4.405-4.252=0.152
max4.615-4.565=0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.229-1.127=0.102
σ0.349-0.251=0.098
min0.912-0.908=0.004
max1.754-1.507=0.246

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean436.787-436.787=-0.000
σ572.359-572.351=0.008
min150.600-150.602=-0.002
max1295.325-1295.314=0.011
mean90.250
σ8.500
min86.000
max103.000
mean1636.000-1638.000=-2.000
σ0.000
min1636.000-1638.000=-2.000
max1636.000-1638.000=-2.000
mean0.540-0.529=0.011
σ0.576-0.556=0.019
min0.250-0.247=0.002
max1.404-1.364=0.040
policies=20
mean1506.276-1506.254=0.022
σ0.256-0.227=0.028
min1506.114-1506.107=0.007
max1506.658-1506.593=0.065
mean860.000
σ0.000
min860.000
max860.000
mean1636.000-1638.000=-2.000
σ0.000
min1636.000-1638.000=-2.000
max1636.000-1638.000=-2.000
mean2.535-2.511=0.024
σ0.027-0.022=0.005
min2.502-2.487=0.016
max2.570-2.535=0.035
policies=200
mean15070.301-15070.374=-0.073
σ0.130-0.057=0.073
min15070.146-15070.316=-0.171
max15070.463-15070.434=0.029
mean8600.000
σ0.000
min8600.000
max8600.000
mean1636.000-1638.000=-2.000
σ0.000
min1636.000-1638.000=-2.000
max1636.000-1638.000=-2.000
mean25.768-25.458=0.310
σ0.237-0.204=0.033
min25.412-25.254=0.158
max25.896-25.642=0.254