Compare commits

Home / Compare 5e06d1e0 .. 63f34f3a

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean33.979-33.979=0.000
σ0.048-0.048=0.000
min33.948-33.949=-0.001
max34.109-34.110=-0.001
mean412.000-415.900=-3.900
σ0.000-0.316=-0.316
min412.000-415.000=-3.000
max412.000-416.000=-4.000
mean0.084-0.082=0.002
σ0.003-0.005=-0.002
min0.081-0.075=0.006
max0.091-0.090=0.001
cache=y
dps=1
iters=10
policies=100
mean23.317-23.317=0.000
σ0.003-0.003=0.000
min23.313-23.313=0.000
max23.323-23.323=0.000
mean412.000-416.000=-4.000
σ0.000
min412.000-416.000=-4.000
max412.000-416.000=-4.000
mean0.065-0.065=0.000
σ0.003-0.002=0.001
min0.063-0.064=-0.001
max0.072-0.072=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1757.365-1757.365=-0.001
σ0.365-0.364=0.001
min1756.790-1756.790=-0.000
max1757.952-1757.952=0.000
mean1644.750-1675.550=-30.800
σ624.640-622.027=2.613
min635.000-671.000=-36.000
max2829.000-2616.000=213.000
mean2.365-2.385=-0.020
σ0.082-0.153=-0.071
min2.269-2.258=0.011
max2.637-2.969=-0.332

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean326.509-326.504=0.006
σ0.054-0.068=-0.014
min326.415-326.383=0.031
max326.552-326.550=0.002
mean2829.000-2616.000=213.000
σ0.000
min2829.000-2616.000=213.000
max2829.000-2616.000=213.000
mean0.431-0.441=-0.010
σ0.007-0.017=-0.010
min0.423-0.423=-0.000
max0.439-0.459=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1988.685-1988.680=0.004
σ0.005-0.007=-0.003
min1988.679-1988.671=0.009
max1988.690-1988.688=0.002
mean2829.000-2616.000=213.000
σ0.000
min2829.000-2616.000=213.000
max2829.000-2616.000=213.000
mean2.663-2.686=-0.023
σ0.135-0.082=0.053
min2.585-2.587=-0.003
max2.905-2.815=0.090
iters=5
new-facts=6402
prior-facts=1
mean4813.527-4813.572=-0.046
σ7.756-7.740=0.016
min4810.011-4810.002=0.009
max4827.401-4827.417=-0.017
mean2829.000-2616.000=213.000
σ0.000
min2829.000-2616.000=213.000
max2829.000-2616.000=213.000
mean8.986-8.822=0.164
σ0.268-0.745=-0.477
min8.688-7.793=0.895
max9.364-9.650=-0.287
iters=5
new-facts=6402
prior-facts=6402
mean5001.079-5001.005=0.074
σ0.027-0.178=-0.150
min5001.055-5000.692=0.364
max5001.123-5001.123=0.000
mean3050.800-2995.200=55.600
σ190.585-259.723=-69.138
min2829.000-2616.000=213.000
max3317.000-3309.000=8.000
mean9.795-9.662=0.133
σ0.214-0.690=-0.476
min9.482-8.452=1.030
max10.062-10.099=-0.037

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.988-1.218=-0.230
σ0.067-0.417=-0.350
min0.898-0.913=-0.015
max1.041-1.801=-0.760

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean464.508-464.502=0.006
σ574.772-574.782=-0.010
min177.110-177.109=0.002
max1326.667-1326.675=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2829.000-2616.000=213.000
σ0.000
min2829.000-2616.000=213.000
max2829.000-2616.000=213.000
mean0.435-0.568=-0.133
σ0.303-0.587=-0.284
min0.280-0.271=0.009
max0.889-1.448=-0.559
policies=20
mean1771.411-1771.388=0.023
σ0.342-0.355=-0.013
min1771.179-1771.158=0.021
max1771.917-1771.915=0.002
mean840.000
σ0.000
min840.000
max840.000
mean2829.000-2616.000=213.000
σ0.000
min2829.000-2616.000=213.000
max2829.000-2616.000=213.000
mean2.807-2.739=0.068
σ0.006-0.032=-0.025
min2.803-2.717=0.086
max2.816-2.786=0.031
policies=200
mean17721.066-17721.119=-0.054
σ0.560-0.524=0.036
min17720.723-17720.808=-0.085
max17721.904-17721.903=0.000
mean8400.000
σ0.000
min8400.000
max8400.000
mean2829.000-2616.000=213.000
σ0.000
min2829.000-2616.000=213.000
max2829.000-2616.000=213.000
mean28.035-27.558=0.477
σ0.356-0.153=0.203
min27.735-27.342=0.393
max28.438-27.678=0.759