Compare commits

Home / Compare 9969e083 .. 4e39b3d3

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean53.711-53.704=0.007
σ0.364-0.363=0.001
min53.582-53.571=0.010
max54.746-54.738=0.009
mean413.600-416.000=-2.400
σ0.516-0.000=0.516
min413.000-416.000=-3.000
max414.000-416.000=-2.000
mean0.140-0.138=0.002
σ0.004-0.004=0.000
min0.136-0.133=0.003
max0.146-0.145=0.002
cache=y
dps=1
iters=10
policies=100
mean42.979-42.978=0.000
σ0.006-0.005=0.001
min42.970-42.971=-0.001
max42.989-42.986=0.003
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.119-0.119=-0.001
σ0.005-0.003=0.002
min0.114-0.115=-0.001
max0.127-0.125=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean995.219-994.904=0.316
σ1.195-1.166=0.029
min994.686-994.358=0.328
max1000.227-999.795=0.432
mean1066.350-1080.600=-14.250
σ315.371-333.473=-18.103
min603.000-597.000=6.000
max1612.000-1638.000=-26.000
mean1.485-1.440=0.045
σ0.075-0.076=-0.001
min1.375-1.381=-0.006
max1.662-1.715=-0.053

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean297.316-297.312=0.004
σ0.006-0.012=-0.006
min297.308-297.295=0.013
max297.323-297.326=-0.003
mean1612.000-1638.000=-26.000
σ0.000
min1612.000-1638.000=-26.000
max1612.000-1638.000=-26.000
mean0.386-0.392=-0.006
σ0.001-0.006=-0.005
min0.385-0.386=-0.001
max0.387-0.400=-0.013
iters=5
new-facts=1
prior-facts=6402
mean1298.985-1298.673=0.312
σ0.084-0.083=0.002
min1298.837-1298.528=0.308
max1299.048-1298.729=0.319
mean1612.000-1638.000=-26.000
σ0.000
min1612.000-1638.000=-26.000
max1612.000-1638.000=-26.000
mean1.941-1.889=0.052
σ0.058-0.064=-0.007
min1.863-1.823=0.040
max2.017-1.985=0.032
iters=5
new-facts=6402
prior-facts=1
mean1719.180-1718.874=0.305
σ6.879-6.889=-0.010
min1715.995-1715.695=0.300
max1731.482-1731.194=0.289
mean1612.000-1638.000=-26.000
σ0.000
min1612.000-1638.000=-26.000
max1612.000-1638.000=-26.000
mean2.911-2.978=-0.067
σ0.263-0.207=0.056
min2.604-2.806=-0.202
max3.271-3.301=-0.029
iters=5
new-facts=6402
prior-facts=6402
mean1981.931-1981.589=0.342
σ0.025-0.041=-0.016
min1981.887-1981.516=0.371
max1981.945-1981.609=0.337
mean1820.600-1850.600=-30.000
σ154.975-207.390=-52.415
min1612.000-1638.000=-26.000
max1957.000-2098.000=-141.000
mean3.143-3.184=-0.040
σ0.129-0.077=0.052
min2.941-3.108=-0.167
max3.253-3.303=-0.050

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.213-1.271=-0.058
σ0.275-0.347=-0.072
min0.917-0.909=0.008
max1.622-1.627=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean440.460-440.374=0.086
σ573.035-572.879=0.156
min153.937-153.927=0.009
max1300.012-1299.693=0.320
mean94.250
σ8.500
min90.000
max107.000
mean1612.000-1638.000=-26.000
σ0.000
min1612.000-1638.000=-26.000
max1612.000-1638.000=-26.000
mean0.548-0.548=0.000
σ0.557-0.564=-0.007
min0.265-0.264=0.001
max1.384-1.394=-0.011
policies=20
mean1539.576-1539.520=0.056
σ0.301-0.316=-0.014
min1539.385-1539.317=0.068
max1540.025-1539.990=0.035
mean900.000
σ0.000
min900.000
max900.000
mean1612.000-1638.000=-26.000
σ0.000
min1612.000-1638.000=-26.000
max1612.000-1638.000=-26.000
mean2.568-2.584=-0.016
σ0.031-0.041=-0.010
min2.537-2.546=-0.008
max2.612-2.642=-0.030
policies=200
mean15403.726-15403.070=0.657
σ0.092-0.101=-0.009
min15403.606-15402.953=0.654
max15403.804-15403.196=0.608
mean9000.000
σ0.000
min9000.000
max9000.000
mean1612.000-1638.000=-26.000
σ0.000
min1612.000-1638.000=-26.000
max1612.000-1638.000=-26.000
mean25.912-25.980=-0.068
σ0.174-0.164=0.010
min25.745-25.823=-0.078
max26.106-26.190=-0.084