Compare commits

Home / Compare 73f6bd0a .. 2d88db0f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean31.040-31.041=-0.000
σ0.050-0.050=0.000
min31.003-30.999=0.003
max31.180-31.179=0.001
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.079-0.079=-0.000
σ0.005-0.002=0.003
min0.071-0.078=-0.006
max0.086-0.084=0.002
cache=y
dps=1
iters=10
policies=100
mean21.142-21.143=-0.001
σ0.002-0.002=0.001
min21.139-21.139=-0.000
max21.147-21.145=0.002
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.061-0.063=-0.002
σ0.003-0.004=-0.000
min0.057-0.058=-0.001
max0.066-0.068=-0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.413-1751.409=0.003
σ0.362-0.365=-0.003
min1750.844-1750.849=-0.005
max1752.000-1751.997=0.004
mean1649.950-1672.200=-22.250
σ644.657-638.842=5.815
min625.000-676.000=-51.000
max2846.000-2712.000=134.000
mean2.771-2.770=0.002
σ0.218-0.262=-0.044
min2.275-2.155=0.120
max3.078-3.351=-0.273

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean266.782-266.782=-0.000
σ0.007-0.005=0.002
min266.775-266.775=-0.001
max266.793-266.786=0.007
mean2846.000-2712.000=134.000
σ0.000
min2846.000-2712.000=134.000
max2846.000-2712.000=134.000
mean0.371-0.364=0.006
σ0.008-0.001=0.007
min0.365-0.363=0.002
max0.380-0.366=0.014
iters=5
new-facts=1
prior-facts=6402
mean1927.219-1927.212=0.007
σ0.010-0.006=0.004
min1927.210-1927.206=0.003
max1927.234-1927.221=0.013
mean2846.000-2712.000=134.000
σ0.000
min2846.000-2712.000=134.000
max2846.000-2712.000=134.000
mean2.915-3.019=-0.104
σ0.313-0.085=0.228
min2.378-2.935=-0.557
max3.171-3.149=0.023
iters=5
new-facts=6402
prior-facts=1
mean4747.635-4747.735=-0.101
σ0.479-0.803=-0.324
min4747.358-4747.334=0.024
max4748.487-4749.170=-0.683
mean2846.000-2712.000=134.000
σ0.000
min2846.000-2712.000=134.000
max2846.000-2712.000=134.000
mean8.233-8.236=-0.002
σ0.339-0.645=-0.307
min7.735-7.662=0.073
max8.666-9.029=-0.363
iters=5
new-facts=6402
prior-facts=6402
mean4938.169-4938.157=0.012
σ0.094-0.084=0.010
min4938.071-4938.075=-0.004
max4938.275-4938.248=0.027
mean3068.800-3018.000=50.800
σ235.131-356.260=-121.129
min2846.000-2712.000=134.000
max3410.000-3541.000=-131.000
mean8.744-8.489=0.255
σ0.285-0.174=0.111
min8.396-8.322=0.074
max9.149-8.707=0.442

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.076-1.212=-0.136
σ0.111-0.141=-0.031
min0.940-1.061=-0.121
max1.249-1.354=-0.105

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean465.119-465.118=0.001
σ575.755-575.767=-0.012
min177.233-177.232=0.001
max1328.751-1328.768=-0.017
mean79.750
σ7.500
min76.000
max91.000
mean2846.000-2712.000=134.000
σ0.000
min2846.000-2712.000=134.000
max2846.000-2712.000=134.000
mean0.438-0.574=-0.136
σ0.303-0.593=-0.290
min0.286-0.272=0.013
max0.893-1.464=-0.571
policies=20
mean1772.622-1772.565=0.057
σ0.332-0.333=-0.001
min1772.385-1772.342=0.043
max1773.111-1773.060=0.050
mean760.000
σ0.000
min760.000
max760.000
mean2846.000-2712.000=134.000
σ0.000
min2846.000-2712.000=134.000
max2846.000-2712.000=134.000
mean2.826-2.742=0.084
σ0.010-0.020=-0.009
min2.816-2.723=0.093
max2.839-2.768=0.071
policies=200
mean17732.508-17732.443=0.065
σ0.365-0.508=-0.144
min17732.210-17732.020=0.189
max17733.036-17733.180=-0.145
mean7600.000
σ0.000
min7600.000
max7600.000
mean2846.000-2712.000=134.000
σ0.000
min2846.000-2712.000=134.000
max2846.000-2712.000=134.000
mean28.177-27.695=0.482
σ0.567-0.224=0.344
min27.620-27.487=0.133
max28.785-27.971=0.813