Compare commits

Home / Compare 5dd006c6 .. b53229fd

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.973-53.972=0.001
σ0.363-0.365=-0.002
min53.840-53.840=0.001
max55.006-55.010=-0.004
mean414.900-418.000=-3.100
σ0.316-0.000=0.316
min414.000-418.000=-4.000
max415.000-418.000=-3.000
mean0.140-0.138=0.002
σ0.003-0.005=-0.001
min0.137-0.132=0.004
max0.145-0.146=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.178-43.177=0.001
σ0.005-0.006=-0.001
min43.171-43.165=0.006
max43.185-43.186=-0.001
mean415.100-418.000=-2.900
σ0.316-0.000=0.316
min415.000-418.000=-3.000
max416.000-418.000=-2.000
mean0.121-0.121=0.000
σ0.004-0.004=0.001
min0.116-0.115=0.001
max0.128-0.127=0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean994.845-994.837=0.009
σ1.226-1.228=-0.002
min994.265-994.270=-0.005
max999.997-1000.005=-0.008
mean1053.550-1056.900=-3.350
σ301.453-303.669=-2.216
min638.000-640.000=-2.000
max1515.000-1523.000=-8.000
mean1.469-1.452=0.017
σ0.046-0.063=-0.016
min1.405-1.302=0.103
max1.545-1.584=-0.040

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.292-297.294=-0.002
σ0.009-0.010=-0.001
min297.278-297.282=-0.004
max297.301-297.309=-0.008
mean1515.000-1523.000=-8.000
σ0.000
min1515.000-1523.000=-8.000
max1515.000-1523.000=-8.000
mean0.391-0.389=0.002
σ0.006-0.009=-0.003
min0.385-0.384=0.001
max0.398-0.405=-0.007
iters=5
new-facts=1
prior-facts=6402
mean1298.544-1298.539=0.004
σ0.128-0.132=-0.004
min1298.480-1298.472=0.008
max1298.772-1298.775=-0.002
mean1515.000-1523.000=-8.000
σ0.000
min1515.000-1523.000=-8.000
max1515.000-1523.000=-8.000
mean1.952-1.945=0.007
σ0.133-0.210=-0.077
min1.842-1.818=0.024
max2.127-2.317=-0.191
iters=5
new-facts=6402
prior-facts=1
mean1820.845-1820.748=0.098
σ6.965-7.084=-0.119
min1817.487-1817.386=0.101
max1833.290-1833.406=-0.116
mean1515.000-1523.000=-8.000
σ0.000
min1515.000-1523.000=-8.000
max1515.000-1523.000=-8.000
mean4.387-4.152=0.235
σ0.270-0.347=-0.077
min4.121-3.894=0.227
max4.826-4.755=0.071
iters=5
new-facts=6402
prior-facts=6402
mean2083.379-2083.371=0.008
σ0.005-0.008=-0.003
min2083.372-2083.359=0.012
max2083.387-2083.380=0.006
mean1808.000-1851.000=-43.000
σ189.316-212.276=-22.960
min1515.000-1584.000=-69.000
max1966.000-2087.000=-121.000
mean4.463-4.559=-0.096
σ0.111-0.230=-0.119
min4.310-4.419=-0.109
max4.565-4.965=-0.400

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.592-1.490=0.102
σ0.379-0.319=0.060
min0.936-0.949=-0.013
max1.896-1.747=0.149

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.372-440.373=-0.001
σ572.865-572.870=-0.005
min153.936-153.930=0.006
max1299.670-1299.678=-0.009
mean94.250
σ8.500
min90.000
max107.000
mean1515.000-1523.000=-8.000
σ0.000
min1515.000-1523.000=-8.000
max1515.000-1523.000=-8.000
mean0.553-0.529=0.024
σ0.594-0.548=0.047
min0.255-0.255=-0.000
max1.444-1.351=0.094
policies=20
mean1539.607-1539.596=0.011
σ0.324-0.303=0.021
min1539.404-1539.392=0.011
max1540.088-1540.046=0.042
mean900.000
σ0.000
min900.000
max900.000
mean1515.000-1523.000=-8.000
σ0.000
min1515.000-1523.000=-8.000
max1515.000-1523.000=-8.000
mean2.601-2.563=0.038
σ0.039-0.014=0.025
min2.560-2.544=0.016
max2.654-2.577=0.076
policies=200
mean15404.016-15403.939=0.076
σ0.039-0.120=-0.082
min15403.971-15403.771=0.200
max15404.063-15404.038=0.025
mean9000.000
σ0.000
min9000.000
max9000.000
mean1515.000-1523.000=-8.000
σ0.000
min1515.000-1523.000=-8.000
max1515.000-1523.000=-8.000
mean25.904-25.937=-0.033
σ0.102-0.099=0.003
min25.814-25.831=-0.017
max26.049-26.046=0.003