Compare commits

Home / Compare fdf47aaa .. ff48549f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.618=-0.000
σ0.055-0.051=0.004
min35.588-35.589=-0.002
max35.773-35.762=0.011
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.083-0.086=-0.002
σ0.004-0.003=0.001
min0.077-0.083=-0.005
max0.091-0.093=-0.002
cache=y
dps=1
iters=10
policies=100
mean24.047-24.047=-0.001
σ0.002-0.002=0.000
min24.043-24.042=0.001
max24.051-24.050=0.001
mean413.000-416.000=-3.000
σ0.000
min413.000-416.000=-3.000
max413.000-416.000=-3.000
mean0.067-0.069=-0.002
σ0.005-0.003=0.001
min0.061-0.066=-0.006
max0.075-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.490-1756.491=-0.001
σ0.365-0.365=-0.000
min1755.914-1755.916=-0.002
max1757.078-1757.079=-0.001
mean1642.400-1645.900=-3.500
σ623.587-644.301=-20.714
min644.000-627.000=17.000
max2829.000-2724.000=105.000
mean2.350-2.352=-0.002
σ0.097-0.101=-0.004
min2.173-2.206=-0.033
max2.591-2.543=0.049

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.763-324.773=-0.010
σ0.056-0.029=0.027
min324.664-324.722=-0.058
max324.804-324.794=0.009
mean2829.000-2724.000=105.000
σ0.000
min2829.000-2724.000=105.000
max2829.000-2724.000=105.000
mean0.422-0.420=0.003
σ0.002-0.008=-0.006
min0.420-0.416=0.005
max0.426-0.433=-0.008
iters=5
new-facts=1
prior-facts=6402
mean1985.323-1985.322=0.001
σ0.010-0.011=-0.001
min1985.314-1985.309=0.005
max1985.336-1985.337=-0.001
mean2829.000-2724.000=105.000
σ0.000
min2829.000-2724.000=105.000
max2829.000-2724.000=105.000
mean2.689-2.688=0.001
σ0.075-0.162=-0.087
min2.571-2.484=0.088
max2.773-2.910=-0.137
iters=5
new-facts=6402
prior-facts=1
mean4808.972-4808.864=0.108
σ7.799-7.775=0.024
min4805.074-4805.019=0.055
max4822.917-4822.758=0.159
mean2829.000-2724.000=105.000
σ0.000
min2829.000-2724.000=105.000
max2829.000-2724.000=105.000
mean8.913-8.782=0.132
σ0.242-0.268=-0.026
min8.588-8.451=0.136
max9.208-9.124=0.084
iters=5
new-facts=6402
prior-facts=6402
mean4996.631-4996.568=0.064
σ0.020-0.142=-0.122
min4996.609-4996.317=0.293
max4996.662-4996.659=0.004
mean3050.200-3042.600=7.600
σ230.840-294.151=-63.311
min2829.000-2724.000=105.000
max3289.000-3338.000=-49.000
mean8.609-9.224=-0.615
σ0.076-0.447=-0.371
min8.495-8.587=-0.092
max8.687-9.616=-0.930

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.978=0.003
σ0.137-0.066=0.071
min0.914-0.920=-0.007
max1.226-1.056=0.170

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.215-463.226=-0.011
σ574.774-574.795=-0.021
min175.816-175.815=0.001
max1325.376-1325.419=-0.043
mean86.250
σ8.500
min82.000
max99.000
mean2829.000-2724.000=105.000
σ0.000
min2829.000-2724.000=105.000
max2829.000-2724.000=105.000
mean0.433-0.552=-0.119
σ0.305-0.552=-0.248
min0.278-0.272=0.006
max0.890-1.381=-0.491
policies=20
mean1758.525-1758.506=0.019
σ0.353-0.337=0.016
min1758.285-1758.297=-0.012
max1759.048-1759.008=0.040
mean820.000
σ0.000
min820.000
max820.000
mean2829.000-2724.000=105.000
σ0.000
min2829.000-2724.000=105.000
max2829.000-2724.000=105.000
mean2.765-2.721=0.045
σ0.021-0.007=0.014
min2.734-2.713=0.021
max2.778-2.727=0.051
policies=200
mean17592.176-17592.155=0.020
σ0.443-0.522=-0.080
min17591.886-17591.861=0.025
max17592.835-17592.938=-0.103
mean8200.000
σ0.000
min8200.000
max8200.000
mean2829.000-2724.000=105.000
σ0.000
min2829.000-2724.000=105.000
max2829.000-2724.000=105.000
mean27.768-27.333=0.435
σ0.397-0.118=0.279
min27.370-27.167=0.203
max28.215-27.420=0.794