Compare commits

Home / Compare 40e2c2ae .. 7432e0b4

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.735-70.695=0.040
σ0.052-0.045=0.007
min70.705-70.670=0.035
max70.880-70.819=0.061
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.156-0.160=-0.004
σ0.004-0.003=0.002
min0.151-0.158=-0.006
max0.164-0.165=-0.002
cache=y
dps=1
iters=10
policies=100
mean21.447-21.424=0.023
σ0.002-0.003=-0.000
min21.444-21.419=0.025
max21.451-21.429=0.022
mean415.000-412.000=3.000
σ0.000
min415.000-412.000=3.000
max415.000-412.000=3.000
mean0.064-0.062=0.002
σ0.003-0.004=-0.000
min0.060-0.059=0.002
max0.072-0.068=0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.878-1751.056=0.823
σ0.359-0.361=-0.002
min1751.309-1750.481=0.828
max1752.456-1751.634=0.822
mean1666.350-1640.850=25.500
σ623.902-597.032=26.870
min654.000-624.000=30.000
max2501.000-2442.000=59.000
mean2.826-2.862=-0.036
σ0.126-0.094=0.032
min2.590-2.720=-0.130
max3.151-3.060=0.091

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean270.966-270.085=0.881
σ0.005-0.004=0.000
min270.960-270.079=0.881
max270.972-270.090=0.882
mean2501.000-2442.000=59.000
σ0.000
min2501.000-2442.000=59.000
max2501.000-2442.000=59.000
mean0.371-0.381=-0.009
σ0.004-0.006=-0.002
min0.367-0.376=-0.009
max0.379-0.391=-0.012
iters=5
new-facts=1
prior-facts=6402
mean1931.361-1930.486=0.876
σ0.024-0.006=0.018
min1931.324-1930.478=0.846
max1931.383-1930.492=0.891
mean2501.000-2442.000=59.000
σ0.000
min2501.000-2442.000=59.000
max2501.000-2442.000=59.000
mean2.929-2.948=-0.019
σ0.202-0.127=0.075
min2.646-2.766=-0.120
max3.194-3.109=0.085
iters=5
new-facts=6402
prior-facts=1
mean4752.092-4751.250=0.842
σ0.844-0.836=0.008
min4751.672-4750.765=0.907
max4753.599-4752.733=0.866
mean2501.000-2442.000=59.000
σ0.000
min2501.000-2442.000=59.000
max2501.000-2442.000=59.000
mean8.393-8.586=-0.193
σ0.323-0.387=-0.064
min7.876-8.012=-0.136
max8.645-9.013=-0.367
iters=5
new-facts=6402
prior-facts=6402
mean4942.513-4941.716=0.797
σ0.145-0.019=0.126
min4942.255-4941.694=0.561
max4942.598-4941.734=0.864
mean2929.400-2989.400=-60.000
σ392.169-263.842=128.326
min2501.000-2629.000=-128.000
max3474.000-3297.000=177.000
mean8.398-8.639=-0.242
σ0.150-0.239=-0.089
min8.305-8.475=-0.169
max8.663-9.060=-0.397

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.682-1.813=-0.131
σ0.199-0.129=0.070
min1.360-1.596=-0.237
max1.848-1.924=-0.076

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean466.057-465.780=0.277
σ574.926-574.930=-0.005
min178.588-178.312=0.276
max1328.446-1328.176=0.270
mean86.250
σ8.500
min82.000
max99.000
mean2501.000-2442.000=59.000
σ0.000
min2501.000-2442.000=59.000
max2501.000-2442.000=59.000
mean0.572-0.555=0.016
σ0.583-0.553=0.030
min0.279-0.276=0.003
max1.446-1.385=0.061
policies=20
mean1786.144-1783.420=2.724
σ0.360-0.371=-0.011
min1785.916-1783.187=2.728
max1786.681-1783.974=2.707
mean820.000
σ0.000
min820.000
max820.000
mean2501.000-2442.000=59.000
σ0.000
min2501.000-2442.000=59.000
max2501.000-2442.000=59.000
mean2.774-2.753=0.021
σ0.021-0.011=0.011
min2.753-2.741=0.012
max2.801-2.766=0.036
policies=200
mean17868.401-17841.260=27.142
σ0.346-0.526=-0.180
min17868.211-17840.961=27.250
max17868.920-17842.045=26.875
mean8200.000
σ0.000
min8200.000
max8200.000
mean2501.000-2442.000=59.000
σ0.000
min2501.000-2442.000=59.000
max2501.000-2442.000=59.000
mean27.851-27.877=-0.026
σ0.040-0.064=-0.024
min27.800-27.823=-0.023
max27.898-27.970=-0.073