Compare commits

Home / Compare ce6206d3 .. 3510da03

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.014=0.001
σ0.370-0.369=0.001
min53.875-53.872=0.002
max55.067-55.065=0.003
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.139-0.137=0.002
σ0.005-0.003=0.002
min0.131-0.131=0.000
max0.147-0.142=0.005
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.001
σ0.007-0.005=0.002
min43.308-43.314=-0.006
max43.332-43.332=0.000
mean418.000-415.000=3.000
σ0.000
min418.000-415.000=3.000
max418.000-415.000=3.000
mean0.123-0.121=0.002
σ0.004-0.005=-0.001
min0.119-0.113=0.006
max0.131-0.128=0.002

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.307-1006.307=-0.000
σ1.170-1.175=-0.004
min1005.769-1005.764=0.005
max1011.211-1011.228=-0.018
mean1045.450
σ314.010-313.228=0.781
min577.000-597.000=-20.000
max1640.000-1639.000=1.000
mean1.562-1.560=0.003
σ0.094-0.099=-0.005
min1.485-1.480=0.005
max1.826-1.843=-0.018

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.432-0.408=0.024
σ0.144-0.143=0.001
min0.320-0.325=-0.005
max0.677-0.663=0.015
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.912-0.876=0.036
σ0.091-0.093=-0.002
min0.846-0.818=0.027
max1.066-1.040=0.026
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.541-0.542=-0.001
σ0.058-0.053=0.005
min0.501-0.507=-0.006
max0.643-0.635=0.009
name=nested_use.art
mean2.360-2.360=-0.000
σ0.002-0.002=-0.000
min2.359
max2.363
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.847-0.849=-0.002
σ0.038-0.038=-0.000
min0.810-0.821=-0.011
max0.903-0.914=-0.011

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.115-964.114=0.001
σ0.033-0.032=0.001
min964.088-964.085=0.002
max964.170-964.166=0.004
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.838-0.830=0.008
σ0.032-0.039=-0.008
min0.797-0.768=0.029
max0.872-0.859=0.013
name=cdr_enhanced_4k_loc.art
mean884.711-884.712=-0.000
σ0.008-0.007=0.000
min884.703-884.705=-0.001
max884.722-884.723=-0.001
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.697-0.679=0.018
σ0.059-0.049=0.010
min0.607-0.609=-0.002
max0.744-0.742=0.002

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=0.000
σ0.002-0.002=0.000
min7.714
max7.718
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean4.218-3.532=0.687
σ0.092-0.083=0.009
min4.074-3.387=0.686
max4.527-3.840=0.687
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666-7.667=-0.001
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean4.199-3.532=0.667
σ0.099-0.072=0.027
min4.063-3.384=0.678
max4.842-3.828=1.015
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.740-0.528=0.212
σ0.020-0.019=0.001
min0.708-0.500=0.208
max0.869-0.634=0.234
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.700-0.505=0.196
σ0.013-0.026=-0.013
min0.668-0.478=0.190
max0.759-0.678=0.081

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.292-296.298=-0.006
σ0.207-0.224=-0.018
min296.096-296.125=-0.030
max296.808-296.907=-0.099
mean1913.000-1921.000=-8.000
σ0.000
min1913.000-1921.000=-8.000
max1913.000-1921.000=-8.000
mean0.585-0.570=0.016
σ0.050-0.044=0.006
min0.514-0.508=0.006
max0.703-0.636=0.067

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.693-284.693=-0.000
σ0.038-0.035=0.004
min284.638-284.649=-0.011
max284.736-284.735=0.001
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.400-0.404=-0.004
σ0.009-0.017=-0.008
min0.389-0.386=0.003
max0.408-0.427=-0.019
iters=5
new-facts=1
prior-facts=6402
mean1295.069-1295.033=0.037
σ0.102-0.103=-0.001
min1294.946-1294.953=-0.006
max1295.201-1295.199=0.003
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean1.900-1.919=-0.019
σ0.072-0.195=-0.123
min1.822-1.782=0.039
max1.985-2.247=-0.262
iters=5
new-facts=6402
prior-facts=1
mean1539.206-1539.236=-0.030
σ6.839-6.820=0.020
min1535.953-1536.084=-0.132
max1551.438-1551.434=0.004
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean2.146-2.305=-0.159
σ0.144-0.270=-0.127
min2.043-2.097=-0.055
max2.394-2.765=-0.371
iters=5
new-facts=6402
prior-facts=6402
mean1856.985-1856.983=0.003
σ0.050-0.062=-0.012
min1856.942-1856.920=0.022
max1857.059-1857.070=-0.011
mean1783.200-1777.200=6.000
σ133.020-139.051=-6.032
min1640.000-1639.000=1.000
max1913.000-1921.000=-8.000
mean3.127-3.011=0.116
σ0.338-0.185=0.154
min2.889-2.836=0.053
max3.723-3.318=0.405

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.242-1.191=0.051
σ0.311-0.339=-0.029
min0.929-0.929=0.000
max1.748-1.745=0.003

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.783-447.784=-0.001
σ581.213-581.213=0.000
min157.174-157.174=-0.000
max1319.602-1319.603=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean0.559-0.547=0.011
σ0.589-0.565=0.024
min0.261-0.261=-0.000
max1.442-1.394=0.048
policies=20
mean1572.082-1572.086=-0.004
σ0.363-0.357=0.007
min1571.836-1571.845=-0.009
max1572.622-1572.616=0.006
mean920.000
σ0.000
min920.000
max920.000
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean2.639-2.634=0.006
σ0.039-0.010=0.029
min2.615-2.623=-0.008
max2.697-2.647=0.050
policies=200
mean15728.881-15729.038=-0.157
σ0.094-0.147=-0.053
min15728.743-15728.872=-0.129
max15728.950-15729.229=-0.279
mean9200.000
σ0.000
min9200.000
max9200.000
mean1640.000-1639.000=1.000
σ0.000
min1640.000-1639.000=1.000
max1640.000-1639.000=1.000
mean26.476-26.512=-0.036
σ0.069-0.155=-0.086
min26.374-26.319=0.055
max26.525-26.696=-0.172