Compare commits

Home / Compare 5f02e25b .. 3ff2385f

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.617-35.617=-0.000
σ0.052-0.054=-0.001
min35.592-35.586=0.006
max35.765-35.769=-0.004
mean414.000
σ0.000
min414.000
max414.000
mean0.085-0.080=0.005
σ0.004-0.004=-0.000
min0.081-0.076=0.005
max0.092-0.088=0.004
cache=y
dps=1
iters=10
policies=100
mean24.048-24.046=0.001
σ0.003-0.004=-0.001
min24.040-24.038=0.002
max24.051-24.051=-0.000
mean414.000
σ0.000
min414.000
max414.000
mean0.068-0.066=0.002
σ0.003-0.004=-0.001
min0.066-0.061=0.005
max0.076-0.071=0.005

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.489-1756.491=-0.002
σ0.365-0.365=-0.000
min1755.915-1755.916=-0.001
max1757.075-1757.079=-0.004
mean1652.200-1647.050=5.150
σ644.668-639.374=5.295
min649.000-625.000=24.000
max2840.000-2822.000=18.000
mean2.352-2.328=0.024
σ0.080-0.075=0.005
min2.267-2.221=0.046
max2.533-2.549=-0.017

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean324.761-324.766=-0.005
σ0.043-0.053=-0.010
min324.684-324.671=0.013
max324.790-324.794=-0.004
mean2840.000-2822.000=18.000
σ0.000
min2840.000-2822.000=18.000
max2840.000-2822.000=18.000
mean0.417-0.431=-0.014
σ0.002-0.010=-0.008
min0.416-0.423=-0.007
max0.420-0.442=-0.022
iters=5
new-facts=1
prior-facts=6402
mean1985.313-1985.317=-0.004
σ0.015-0.022=-0.006
min1985.292-1985.297=-0.005
max1985.334-1985.343=-0.009
mean2840.000-2822.000=18.000
σ0.000
min2840.000-2822.000=18.000
max2840.000-2822.000=18.000
mean2.636-2.636=0.000
σ0.129-0.134=-0.004
min2.515-2.518=-0.003
max2.817-2.812=0.005
iters=5
new-facts=6402
prior-facts=1
mean4809.111-4809.120=-0.009
σ7.773-7.705=0.068
min4805.604-4805.573=0.030
max4823.016-4822.903=0.113
mean2840.000-2822.000=18.000
σ0.000
min2840.000-2822.000=18.000
max2840.000-2822.000=18.000
mean9.162-8.833=0.329
σ0.341-0.473=-0.133
min8.925-7.993=0.932
max9.755-9.127=0.629
iters=5
new-facts=6402
prior-facts=6402
mean4996.552-4996.626=-0.074
σ0.151-0.024=0.127
min4996.285-4996.593=-0.309
max4996.646-4996.653=-0.007
mean3047.600-3054.400=-6.800
σ270.853-303.324=-32.471
min2840.000-2822.000=18.000
max3465.000-3520.000=-55.000
mean8.503-8.512=-0.009
σ0.114-0.122=-0.008
min8.444-8.410=0.033
max8.705-8.723=-0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean0.981-0.978=0.002
σ0.068-0.068=0.000
min0.924-0.921=0.003
max1.056-1.058=-0.002

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean463.205-463.210=-0.005
σ574.774-574.773=0.001
min175.808-175.814=-0.006
max1325.366-1325.369=-0.003
mean86.250
σ8.500
min82.000
max99.000
mean2840.000-2822.000=18.000
σ0.000
min2840.000-2822.000=18.000
max2840.000-2822.000=18.000
mean0.430-0.434=-0.004
σ0.299-0.301=-0.002
min0.278-0.280=-0.002
max0.878-0.886=-0.007
policies=20
mean1758.488-1758.505=-0.017
σ0.353-0.353=-0.001
min1758.241-1758.269=-0.029
max1759.009-1759.030=-0.021
mean820.000
σ0.000
min820.000
max820.000
mean2840.000-2822.000=18.000
σ0.000
min2840.000-2822.000=18.000
max2840.000-2822.000=18.000
mean2.788-2.780=0.009
σ0.005-0.006=-0.001
min2.781-2.771=0.010
max2.792-2.783=0.009
policies=200
mean17591.980-17592.135=-0.155
σ0.432-0.487=-0.055
min17591.725-17591.828=-0.103
max17592.626-17592.861=-0.235
mean8200.000
σ0.000
min8200.000
max8200.000
mean2840.000-2822.000=18.000
σ0.000
min2840.000-2822.000=18.000
max2840.000-2822.000=18.000
mean27.908-27.803=0.106
σ0.376-0.378=-0.002
min27.527-27.465=0.062
max28.323-28.224=0.099