Compare commits

Home / Compare 215464b7 .. a6f0edc8

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.263-35.245=0.018
σ0.053-0.053=-0.000
min35.234-35.216=0.018
max35.413-35.394=0.019
mean416.700-413.000=3.700
σ0.483-0.000=0.483
min416.000-413.000=3.000
max417.000-413.000=4.000
mean0.083-0.086=-0.003
σ0.004-0.004=0.000
min0.076-0.082=-0.006
max0.092-0.094=-0.003
cache=y
dps=1
iters=10
policies=100
mean23.770-23.769=0.001
σ0.002-0.003=-0.000
min23.767-23.764=0.003
max23.773-23.774=-0.002
mean417.000-413.000=4.000
σ0.000
min417.000-413.000=4.000
max417.000-413.000=4.000
mean0.068-0.068=0.000
σ0.003-0.003=0.000
min0.066-0.066=-0.000
max0.074-0.076=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.487-1756.484=0.003
σ0.365-0.365=-0.000
min1755.910-1755.908=0.002
max1757.071-1757.076=-0.005
mean1656.600-1660.500=-3.900
σ644.932-647.449=-2.517
min629.000
max2849.000-2812.000=37.000
mean2.338-2.352=-0.014
σ0.073-0.085=-0.012
min2.240-2.256=-0.016
max2.505-2.597=-0.092

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.705-324.702=0.003
σ0.057-0.058=-0.002
min324.605-324.599=0.007
max324.739-324.735=0.003
mean2849.000-2812.000=37.000
σ0.000
min2849.000-2812.000=37.000
max2849.000-2812.000=37.000
mean0.429-0.435=-0.005
σ0.011-0.012=-0.001
min0.420-0.422=-0.002
max0.447-0.451=-0.004
iters=5
new-facts=1
prior-facts=6402
mean1985.267-1985.265=0.002
σ0.011-0.010=0.001
min1985.250-1985.248=0.003
max1985.279-1985.274=0.005
mean2849.000-2812.000=37.000
σ0.000
min2849.000-2812.000=37.000
max2849.000-2812.000=37.000
mean2.602-2.596=0.006
σ0.099-0.116=-0.016
min2.522-2.438=0.084
max2.771-2.752=0.019
iters=5
new-facts=6402
prior-facts=1
mean4808.886-4808.753=0.133
σ7.712-7.429=0.283
min4805.413-4805.371=0.041
max4822.681-4822.042=0.639
mean2849.000-2812.000=37.000
σ0.000
min2849.000-2812.000=37.000
max2849.000-2812.000=37.000
mean9.099-8.963=0.136
σ0.172-0.117=0.055
min8.919-8.830=0.089
max9.292-9.085=0.207
iters=5
new-facts=6402
prior-facts=6402
mean4996.389-4996.459=-0.070
σ0.159-0.016=0.143
min4996.107-4996.434=-0.327
max4996.481-4996.476=0.006
mean3071.600-3047.200=24.400
σ297.107-301.112=-4.005
min2849.000-2812.000=37.000
max3529.000-3506.000=23.000
mean8.497-8.554=-0.056
σ0.093-0.142=-0.050
min8.406-8.416=-0.011
max8.650-8.726=-0.076

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.997-0.945=0.052
σ0.062-0.060=0.002
min0.915-0.902=0.013
max1.044-1.049=-0.005

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean462.976-462.968=0.009
σ574.253-574.255=-0.001
min175.841-175.838=0.003
max1324.356-1324.349=0.007
mean86.250
σ8.500
min82.000
max99.000
mean2849.000-2812.000=37.000
σ0.000
min2849.000-2812.000=37.000
max2849.000-2812.000=37.000
mean0.411-0.454=-0.043
σ0.255-0.352=-0.096
min0.283-0.264=0.018
max0.794-0.981=-0.187
policies=20
mean1758.713-1758.723=-0.010
σ0.349-0.372=-0.023
min1758.467-1758.485=-0.018
max1759.229-1759.276=-0.047
mean820.000
σ0.000
min820.000
max820.000
mean2849.000-2812.000=37.000
σ0.000
min2849.000-2812.000=37.000
max2849.000-2812.000=37.000
mean2.796-2.787=0.008
σ0.024-0.019=0.005
min2.776-2.762=0.015
max2.830-2.801=0.029
policies=200
mean17593.410-17592.512=0.898
σ0.541-0.456=0.085
min17592.763-17592.200=0.563
max17593.874-17593.175=0.699
mean8200.000
σ0.000
min8200.000
max8200.000
mean2849.000-2812.000=37.000
σ0.000
min2849.000-2812.000=37.000
max2849.000-2812.000=37.000
mean27.940-27.506=0.434
σ0.335-0.139=0.196
min27.561-27.314=0.247
max28.286-27.641=0.646