Compare commits

Home / Compare 1657ea96 .. 17142d91

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean70.731-70.734=-0.003
σ0.045-0.045=0.000
min70.711-70.711=0.000
max70.857-70.860=-0.003
mean412.000-415.000=-3.000
σ0.000
min412.000-415.000=-3.000
max412.000-415.000=-3.000
mean0.159-0.175=-0.016
σ0.005-0.009=-0.004
min0.154-0.153=0.001
max0.170-0.187=-0.016
cache=y
dps=1
iters=10
policies=100
mean21.446-21.445=0.001
σ0.002-0.003=-0.001
min21.443-21.441=0.002
max21.450-21.451=-0.000
mean413.000-415.000=-2.000
σ0.000
min413.000-415.000=-2.000
max413.000-415.000=-2.000
mean0.062-0.065=-0.003
σ0.003-0.002=0.001
min0.059-0.064=-0.005
max0.071-0.072=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1754.527-1754.526=0.000
σ0.358-0.362=-0.005
min1753.955-1753.958=-0.003
max1755.109-1755.130=-0.022
mean1672.850-1658.250=14.600
σ650.724-633.777=16.947
min623.000-641.000=-18.000
max2870.000-2849.000=21.000
mean2.806-2.760=0.047
σ0.181-0.216=-0.035
min2.188-2.293=-0.105
max2.983-3.045=-0.062

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean273.610-273.611=-0.001
σ0.005-0.011=-0.005
min273.602-273.600=0.002
max273.615-273.626=-0.011
mean2870.000-2849.000=21.000
σ0.000
min2870.000-2849.000=21.000
max2870.000-2849.000=21.000
mean0.384-0.391=-0.007
σ0.004-0.008=-0.004
min0.381-0.381=0.001
max0.391-0.399=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1933.997-1934.004=-0.008
σ0.012-0.015=-0.003
min1933.975-1933.994=-0.019
max1934.006-1934.031=-0.025
mean2870.000-2849.000=21.000
σ0.000
min2870.000-2849.000=21.000
max2870.000-2849.000=21.000
mean3.025-3.122=-0.097
σ0.070-0.262=-0.191
min2.955-2.945=0.010
max3.118-3.580=-0.462
iters=5
new-facts=6402
prior-facts=1
mean4754.758-4754.764=-0.007
σ0.843-0.842=0.001
min4754.211-4754.295=-0.084
max4756.249-4756.264=-0.015
mean2870.000-2849.000=21.000
σ0.000
min2870.000-2849.000=21.000
max2870.000-2849.000=21.000
mean8.694-8.542=0.152
σ0.396-0.308=0.088
min8.401-8.124=0.278
max9.374-8.881=0.493
iters=5
new-facts=6402
prior-facts=6402
mean4945.224-4945.158=0.067
σ0.019-0.165=-0.146
min4945.207-4944.866=0.341
max4945.246-4945.256=-0.010
mean3049.600-3067.000=-17.400
σ188.130-188.917=-0.787
min2870.000-2849.000=21.000
max3320.000-3331.000=-11.000
mean8.478-8.553=-0.074
σ0.098-0.179=-0.081
min8.376-8.413=-0.037
max8.616-8.852=-0.236

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-1.045=-0.049
σ0.140-0.240=-0.100
min0.930-0.936=-0.006
max1.247-1.475=-0.228

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean472.848-472.851=-0.002
σ574.936-574.941=-0.005
min185.374-185.369=0.005
max1335.253-1335.262=-0.009
mean88.250
σ8.500
min84.000
max101.000
mean2870.000-2849.000=21.000
σ0.000
min2870.000-2849.000=21.000
max2870.000-2849.000=21.000
mean0.451-0.489=-0.039
σ0.305-0.377=-0.072
min0.293-0.298=-0.004
max0.909-1.055=-0.147
policies=20
mean1854.011-1854.025=-0.014
σ0.366-0.366=-0.000
min1853.744-1853.738=0.006
max1854.545-1854.556=-0.011
mean840.000
σ0.000
min840.000
max840.000
mean2870.000-2849.000=21.000
σ0.000
min2870.000-2849.000=21.000
max2870.000-2849.000=21.000
mean2.961-2.949=0.011
σ0.018-0.004=0.014
min2.949-2.944=0.005
max2.987-2.953=0.034
policies=200
mean18546.682-18546.843=-0.160
σ0.376-0.460=-0.084
min18546.426-18546.526=-0.099
max18547.236-18547.521=-0.285
mean8400.000
σ0.000
min8400.000
max8400.000
mean2870.000-2849.000=21.000
σ0.000
min2870.000-2849.000=21.000
max2870.000-2849.000=21.000
mean29.138-29.158=-0.020
σ0.451-0.462=-0.010
min28.875-28.704=0.171
max29.812-29.761=0.051