Compare commits

Home / Compare 12efd224 .. b9647307

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean30.959-30.958=0.001
σ0.050-0.049=0.001
min30.918-30.917=0.001
max31.097-31.095=0.003
mean414.000
σ0.000
min414.000
max414.000
mean0.078-0.079=-0.001
σ0.004-0.003=0.000
min0.071-0.076=-0.004
max0.084-0.084=0.000
cache=y
dps=1
iters=10
policies=100
mean21.060-21.060=0.000
σ0.003-0.003=0.000
min21.056-21.054=0.002
max21.066-21.064=0.002
mean414.000
σ0.000
min414.000
max414.000
mean0.063-0.062=0.001
σ0.004-0.002=0.001
min0.058-0.058=0.000
max0.071-0.065=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1751.410-1751.412=-0.002
σ0.359-0.362=-0.002
min1750.849-1750.840=0.009
max1751.992-1752.007=-0.015
mean1654.950-1661.950=-7.000
σ647.793-622.704=25.090
min650.000-643.000=7.000
max2858.000-2508.000=350.000
mean2.826-2.809=0.017
σ0.156-0.162=-0.006
min2.519-2.352=0.167
max3.122-3.050=0.073

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean275.758-275.764=-0.006
σ0.005-0.013=-0.007
min275.750-275.748=0.002
max275.763-275.781=-0.018
mean2858.000-2508.000=350.000
σ0.000
min2858.000-2508.000=350.000
max2858.000-2508.000=350.000
mean0.392-0.403=-0.012
σ0.009-0.008=0.001
min0.385-0.397=-0.012
max0.408-0.416=-0.008
iters=5
new-facts=1
prior-facts=6402
mean2168.287-2168.291=-0.004
σ0.009-0.017=-0.008
min2168.279-2168.269=0.009
max2168.301-2168.310=-0.009
mean2858.000-2508.000=350.000
σ0.000
min2858.000-2508.000=350.000
max2858.000-2508.000=350.000
mean2.836-2.874=-0.038
σ0.079-0.115=-0.037
min2.757-2.774=-0.017
max2.951-3.003=-0.053
iters=5
new-facts=6402
prior-facts=1
mean4889.254-4889.187=0.066
σ354.515-355.850=-1.335
min4255.077-4252.625=2.452
max5048.163-5049.760=-1.597
mean2858.000-2508.000=350.000
σ0.000
min2858.000-2508.000=350.000
max2858.000-2508.000=350.000
mean8.530-8.546=-0.016
σ0.618-0.712=-0.095
min7.520-7.498=0.023
max9.150-9.262=-0.112
iters=5
new-facts=6402
prior-facts=6402
mean5179.238-5179.168=0.070
σ0.090-0.204=-0.114
min5179.169-5178.819=0.349
max5179.349-5179.317=0.032
mean3187.400-3080.600=106.800
σ334.764-461.709=-126.945
min2858.000-2515.000=343.000
max3704.000-3711.000=-7.000
mean9.918-9.794=0.123
σ0.135-0.181=-0.045
min9.711-9.584=0.127
max10.072-10.068=0.004

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.057-1.616=-0.559
σ0.129-0.155=-0.026
min0.943-1.422=-0.478
max1.261-1.804=-0.543

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.336-463.333=0.003
σ572.194-572.197=-0.003
min177.232-177.231=0.002
max1321.628-1321.629=-0.001
mean79.750
σ7.500
min76.000
max91.000
mean2858.000-2508.000=350.000
σ0.000
min2858.000-2508.000=350.000
max2858.000-2508.000=350.000
mean0.442-0.555=-0.113
σ0.306-0.550=-0.245
min0.287-0.275=0.012
max0.900-1.381=-0.481
policies=20
mean1772.606-1772.579=0.026
σ0.337-0.342=-0.005
min1772.350-1772.337=0.013
max1773.098-1773.085=0.013
mean760.000
σ0.000
min760.000
max760.000
mean2858.000-2508.000=350.000
σ0.000
min2858.000-2508.000=350.000
max2858.000-2508.000=350.000
mean2.836-2.753=0.083
σ0.011-0.006=0.005
min2.826-2.748=0.078
max2.852-2.761=0.091
policies=200
mean17732.583-17732.383=0.201
σ0.494-0.428=0.065
min17732.207-17732.103=0.104
max17733.309-17733.014=0.295
mean7600.000
σ0.000
min7600.000
max7600.000
mean2858.000-2508.000=350.000
σ0.000
min2858.000-2508.000=350.000
max2858.000-2508.000=350.000
mean28.200-27.834=0.366
σ0.492-0.134=0.358
min27.684-27.697=-0.012
max28.728-28.016=0.711