Compare commits

Home / Compare 5748f08b .. 6f4db6f9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean35.957-35.958=-0.001
σ0.102-0.103=-0.000
min35.915-35.915=0.000
max36.247-36.248=-0.002
mean411.000-413.000=-2.000
σ0.000
min411.000-413.000=-2.000
max411.000-413.000=-2.000
mean0.075-0.077=-0.002
σ0.004-0.005=-0.000
min0.070-0.071=-0.001
max0.084-0.085=-0.001
cache=y
dps=1
iters=10
policies=100
mean26.203-26.203=0.001
σ0.002-0.006=-0.003
min26.200-26.195=0.005
max26.207-26.208=-0.002
mean411.000-413.600=-2.600
σ0.000-0.516=-0.516
min411.000-413.000=-2.000
max411.000-414.000=-3.000
mean0.061-0.059=0.002
σ0.003-0.004=-0.001
min0.059-0.055=0.004
max0.070-0.069=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1756.304-1756.304=-0.000
σ0.368-0.367=0.002
min1755.728-1755.726=0.002
max1756.897-1756.898=-0.001
mean1655.150-1664.300=-9.150
σ627.561-629.090=-1.529
min608.000-679.000=-71.000
max2640.000-2694.000=-54.000
mean2.364-2.335=0.029
σ0.180-0.100=0.080
min2.206-2.059=0.147
max3.068-2.459=0.609

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean278.821-278.828=-0.007
σ0.004-0.004=0.000
min278.816-278.822=-0.006
max278.827-278.833=-0.006
mean2640.000-2694.000=-54.000
σ0.000
min2640.000-2694.000=-54.000
max2640.000-2694.000=-54.000
mean0.410-0.411=-0.001
σ0.001-0.006=-0.004
min0.409-0.407=0.002
max0.412-0.418=-0.006
iters=5
new-facts=1
prior-facts=6402
mean2268.885-2268.868=0.016
σ0.016-0.059=-0.042
min2268.861-2268.766=0.095
max2268.907-2268.910=-0.004
mean2640.000-2694.000=-54.000
σ0.000
min2640.000-2694.000=-54.000
max2640.000-2694.000=-54.000
mean3.029-3.067=-0.038
σ0.134-0.171=-0.036
min2.887-2.892=-0.005
max3.203-3.310=-0.106
iters=5
new-facts=6402
prior-facts=1
mean4954.288-4954.186=0.103
σ0.872-1.039=-0.167
min4953.844-4953.258=0.586
max4955.845-4955.958=-0.114
mean2640.000-2694.000=-54.000
σ0.000
min2640.000-2694.000=-54.000
max2640.000-2694.000=-54.000
mean8.031-7.994=0.037
σ0.191-0.422=-0.231
min7.808-7.645=0.162
max8.278-8.711=-0.433
iters=5
new-facts=6402
prior-facts=6402
mean5168.826-5168.827=-0.001
σ0.090-0.090=0.000
min5168.726-5168.728=-0.002
max5168.906-5168.906=-0.001
mean3458.400-3436.800=21.600
σ495.702-473.191=22.511
min2845.000-2885.000=-40.000
max4166.000-4123.000=43.000
mean9.284-9.369=-0.084
σ0.299-0.355=-0.055
min8.951-9.081=-0.130
max9.616-9.844=-0.229

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.084-1.213=-0.128
σ0.168-0.443=-0.274
min0.944-0.950=-0.006
max1.364-1.996=-0.632

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean460.354-460.352=0.002
σ572.658-572.662=-0.004
min174.011-174.014=-0.002
max1319.342-1319.345=-0.003
mean79.500
σ7.000
min76.000
max90.000
mean2640.000-2694.000=-54.000
σ0.000
min2640.000-2694.000=-54.000
max2640.000-2694.000=-54.000
mean0.564-0.547=0.017
σ0.591-0.539=0.053
min0.266-0.273=-0.007
max1.451-1.355=0.096
policies=20
mean1740.429-1740.427=0.002
σ0.316-0.318=-0.002
min1740.232-1740.226=0.007
max1740.901-1740.901=-0.001
mean760.000
σ0.000
min760.000
max760.000
mean2640.000-2694.000=-54.000
σ0.000
min2640.000-2694.000=-54.000
max2640.000-2694.000=-54.000
mean2.688-2.675=0.013
σ0.029-0.030=-0.001
min2.664-2.637=0.027
max2.730-2.707=0.023
policies=200
mean17411.183-17411.295=-0.112
σ0.567-0.469=0.098
min17410.882-17411.030=-0.148
max17412.034-17411.998=0.036
mean7600.000
σ0.000
min7600.000
max7600.000
mean2640.000-2694.000=-54.000
σ0.000
min2640.000-2694.000=-54.000
max2640.000-2694.000=-54.000
mean27.046-27.029=0.017
σ0.034-0.114=-0.081
min27.011-26.930=0.081
max27.079-27.193=-0.114