Compare commits

Home / Compare ef319667 .. 62a2f4fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean36.724-36.729=-0.005
σ0.713-0.851=-0.138
min35.922-35.921=0.001
max37.602-38.442=-0.840
mean4107.000-3940.000=167.000
σ0.000
min4107.000-3940.000=167.000
max4107.000-3940.000=167.000
mean0.075-0.076=-0.001
σ0.001-0.001=-0.001
min0.075-0.075=-0.000
max0.076-0.080=-0.003
cache=y
dps=1
iters=10
policies=100
mean26.713-26.712=0.000
σ0.644-0.645=-0.001
min26.206-26.211=-0.004
max27.465-27.464=0.001
mean4107.000-3940.000=167.000
σ0.000
min4107.000-3940.000=167.000
max4107.000-3940.000=167.000
mean0.061-0.061=-0.000
σ0.001-0.000=0.000
min0.060-0.060=-0.000
max0.061-0.061=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.368-1756.366=0.001
σ0.374-0.374=0.000
min1755.797-1755.791=0.006
max1756.962-1756.967=-0.005
mean1670.600-1656.300=14.300
σ624.793-627.183=-2.390
min661.000-683.000=-22.000
max2602.000-2606.000=-4.000
mean2.291-2.278=0.013
σ0.157-0.161=-0.004
min2.138-2.119=0.019
max2.790-2.787=0.003

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.697-278.694=0.003
σ0.014-0.014=-0.000
min278.684-278.682=0.001
max278.720-278.718=0.002
mean2602.000-2606.000=-4.000
σ0.000
min2602.000-2606.000=-4.000
max2602.000-2606.000=-4.000
mean0.417-0.417=-0.000
σ0.001-0.002=-0.001
min0.414-0.415=-0.001
max0.418-0.421=-0.004
iters=5
new-facts=1
prior-facts=6402
mean2268.870-2268.873=-0.003
σ0.005-0.007=-0.002
min2268.861-2268.865=-0.004
max2268.873-2268.883=-0.010
mean2602.000-2606.000=-4.000
σ0.000
min2602.000-2606.000=-4.000
max2602.000-2606.000=-4.000
mean3.045-2.878=0.167
σ0.142-0.107=0.035
min2.865-2.742=0.123
max3.172-3.019=0.152
iters=5
new-facts=6402
prior-facts=1
mean4952.347-4952.325=0.022
σ0.816-0.892=-0.076
min4951.924-4951.844=0.080
max4953.806-4953.918=-0.112
mean2602.000-2606.000=-4.000
σ0.000
min2602.000-2606.000=-4.000
max2602.000-2606.000=-4.000
mean7.908-8.156=-0.248
σ0.261-0.307=-0.046
min7.668-7.732=-0.063
max8.320-8.584=-0.263
iters=5
new-facts=6402
prior-facts=6402
mean5167.082-5167.013=0.069
σ0.017-0.145=-0.128
min5167.066-5166.753=0.313
max5167.102-5167.090=0.013
mean3432.600-3392.400=40.200
σ467.525-445.064=22.461
min2854.000-2769.000=85.000
max4107.000-3940.000=167.000
mean9.206-9.489=-0.283
σ0.389-0.437=-0.048
min8.540-9.032=-0.492
max9.566-10.071=-0.505

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.045-1.184=-0.138
σ0.111-0.188=-0.077
min0.942-1.057=-0.115
max1.212-1.490=-0.278

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.259-460.257=0.002
σ572.608-572.607=0.000
min173.954-173.953=0.001
max1319.171-1319.169=0.002
mean79.500
σ7.000
min76.000
max90.000
mean435.000-437.000=-2.000
σ0.000
min435.000-437.000=-2.000
max435.000-437.000=-2.000
mean0.581-0.546=0.034
σ0.610-0.548=0.063
min0.273-0.266=0.007
max1.497-1.368=0.129
policies=20
mean1740.040-1740.029=0.011
σ0.329-0.322=0.007
min1739.803-1739.796=0.007
max1740.523-1740.501=0.022
mean760.000
σ0.000
min760.000
max760.000
mean446.500-447.250=-0.750
σ11.091-10.178=0.913
min435.000-437.000=-2.000
max456.000
mean2.655-2.652=0.003
σ0.025-0.023=0.001
min2.632-2.634=-0.002
max2.690-2.686=0.004
policies=200
mean17409.917-17409.806=0.111
σ0.092-0.039=0.053
min17409.782-17409.763=0.019
max17409.989-17409.846=0.143
mean7600.000
σ0.000
min7600.000
max7600.000
mean491.250-491.750=-0.500
σ2.217-2.754=-0.536
min489.000
max494.000-495.000=-1.000
mean26.858-26.843=0.015
σ0.067-0.107=-0.040
min26.778-26.730=0.048
max26.914-26.988=-0.074