Compare commits

Home / Compare c34062eb .. 20deceb5

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.030-54.031=-0.000
σ0.368-0.369=-0.001
min53.889-53.891=-0.002
max55.077-55.080=-0.003
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.136-0.139=-0.002
σ0.005-0.005=0.000
min0.130-0.133=-0.003
max0.141-0.149=-0.008
cache=y
dps=1
iters=10
policies=100
mean43.384-43.384=0.001
σ0.007-0.007=0.000
min43.376-43.376=0.000
max43.395-43.393=0.002
mean414.000-418.000=-4.000
σ0.000
min414.000-418.000=-4.000
max414.000-418.000=-4.000
mean0.122-0.120=0.002
σ0.004-0.004=-0.000
min0.116-0.114=0.002
max0.127-0.128=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.332-1006.329=0.003
σ0.882-0.927=-0.045
min1005.836-1005.856=-0.020
max1009.993-1010.185=-0.192
mean1042.450-1052.850=-10.400
σ306.151-310.247=-4.096
min573.000-555.000=18.000
max1657.000-1646.000=11.000
mean1.559-1.550=0.009
σ0.080-0.144=-0.064
min1.481-1.336=0.145
max1.813-1.930=-0.118

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883-0.882=0.001
σ0.002-0.002=0.000
min0.881
max0.886
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.423-0.415=0.008
σ0.133-0.124=0.009
min0.343-0.347=-0.004
max0.658-0.635=0.024
name=error_case.art
mean2.333-2.334=-0.001
σ0.003-0.003=0.000
min2.332
max2.337
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.892-0.886=0.006
σ0.075-0.085=-0.011
min0.840-0.829=0.011
max1.022-1.035=-0.013
name=heavy_item.art
mean1.521-1.521=0.000
σ0.002-0.001=0.001
min1.520
max1.524-1.523=0.001
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.547-0.544=0.003
σ0.051-0.049=0.001
min0.514-0.506=0.007
max0.636-0.630=0.006
name=nested_use.art
mean2.355-2.356=-0.001
σ0.002-0.002=-0.000
min2.355
max2.358
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.842-0.844=-0.002
σ0.034-0.044=-0.010
min0.806-0.804=0.002
max0.894-0.919=-0.025

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean963.552-963.551=0.001
σ0.025-0.024=0.001
min963.523-963.524=-0.001
max963.583-963.582=0.001
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.821-0.813=0.008
σ0.035-0.026=0.009
min0.775-0.779=-0.004
max0.856-0.849=0.007
name=cdr_enhanced_4k_loc.art
mean884.856-884.857=-0.001
σ0.005-0.005=0.001
min884.847-884.851=-0.004
max884.861-884.861=0.001
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.705-0.708=-0.004
σ0.048-0.043=0.005
min0.623-0.652=-0.029
max0.746-0.743=0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.706-7.706=0.000
σ0.002-0.002=0.000
min7.705
max7.710-7.711=-0.000
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean4.223-4.246=-0.023
σ0.121-0.072=0.049
min4.042-4.107=-0.065
max5.105-4.549=0.556
name=record_render_large_syntax_err.art
mean7.655
σ0.002
min7.654
max7.658
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean4.206-4.236=-0.030
σ0.082-0.077=0.005
min4.086-4.092=-0.006
max4.467-4.515=-0.047
name=record_render_success.art
mean2.288
σ0.002
min2.287
max2.291
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.576-0.747=-0.171
σ0.091-0.018=0.073
min0.507-0.719=-0.212
max0.868-0.871=-0.003
name=record_render_syntax_err.art
mean2.163
σ0.002
min2.163
max2.166
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.506-0.710=-0.205
σ0.012-0.020=-0.008
min0.485-0.602=-0.117
max0.557-0.787=-0.230

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.584-295.632=-0.048
σ0.247-0.196=0.051
min295.362-295.443=-0.080
max296.219-296.117=0.103
mean1909.000-1907.000=2.000
σ0.000
min1909.000-1907.000=2.000
max1909.000-1907.000=2.000
mean0.572-0.557=0.015
σ0.048-0.035=0.013
min0.504-0.502=0.003
max0.671-0.623=0.048

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.249-285.245=0.004
σ0.040-0.038=0.002
min285.193-285.195=-0.001
max285.291-285.287=0.005
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.396-0.388=0.008
σ0.010-0.008=0.001
min0.385-0.380=0.005
max0.407-0.402=0.005
iters=5
new-facts=1
prior-facts=6402
mean1295.197-1295.197=-0.000
σ0.105-0.108=-0.004
min1295.082-1295.068=0.015
max1295.320-1295.314=0.006
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean1.912-1.904=0.009
σ0.101-0.142=-0.041
min1.785-1.696=0.089
max2.025-2.023=0.002
iters=5
new-facts=6402
prior-facts=1
mean1538.084-1538.096=-0.011
σ4.022-4.052=-0.030
min1536.051-1536.052=-0.001
max1545.270-1545.332=-0.062
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean2.278-2.335=-0.057
σ0.218-0.351=-0.133
min2.049-2.025=0.023
max2.549-2.794=-0.246
iters=5
new-facts=6402
prior-facts=6402
mean1857.106-1857.105=0.001
σ0.053-0.051=0.002
min1857.061-1857.057=0.004
max1857.180-1857.176=0.004
mean1781.600-1777.400=4.200
σ126.039-128.788=-2.749
min1657.000-1646.000=11.000
max1909.000-1907.000=2.000
mean3.062-3.041=0.021
σ0.297-0.274=0.023
min2.861-2.874=-0.013
max3.588-3.527=0.061

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.381-1.408=-0.027
σ0.262-0.229=0.033
min1.229-1.264=-0.035
max1.847-1.805=0.042

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean443.609-443.611=-0.002
σ577.065-577.065=0.000
min155.076-155.077=-0.002
max1309.206-1309.208=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean0.546-0.552=-0.005
σ0.574-0.579=-0.005
min0.258-0.262=-0.004
max1.408-1.421=-0.013
policies=20
mean1551.020-1551.043=-0.023
σ0.323-0.330=-0.007
min1550.797-1550.815=-0.017
max1551.500-1551.534=-0.034
mean920.000
σ0.000
min920.000
max920.000
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean2.586-2.596=-0.011
σ0.015-0.013=0.001
min2.572-2.584=-0.012
max2.602-2.608=-0.006
policies=200
mean15518.501-15518.559=-0.058
σ0.136-0.083=0.052
min15518.332-15518.465=-0.133
max15518.628-15518.668=-0.039
mean9200.000
σ0.000
min9200.000
max9200.000
mean1657.000-1646.000=11.000
σ0.000
min1657.000-1646.000=11.000
max1657.000-1646.000=11.000
mean26.218-26.192=0.026
σ0.224-0.140=0.084
min26.016-26.099=-0.083
max26.538-26.398=0.140