Compare commits

Home / Compare 2e24d85e .. 8d7f3ade

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.055=0.000
σ0.369-0.370=-0.001
min53.913-53.914=-0.001
max55.105-55.106=-0.001
mean422.000-418.000=4.000
σ0.000
min422.000-418.000=4.000
max422.000-418.000=4.000
mean0.140-0.141=-0.001
σ0.006-0.004=0.002
min0.131-0.138=-0.007
max0.150-0.147=0.003
cache=y
dps=1
iters=10
policies=100
mean43.393-43.394=-0.001
σ0.006-0.006=0.000
min43.383-43.388=-0.004
max43.403-43.406=-0.002
mean422.000-418.000=4.000
σ0.000
min422.000-418.000=4.000
max422.000-418.000=4.000
mean0.118-0.120=-0.002
σ0.003-0.001=0.002
min0.115-0.119=-0.004
max0.122-0.122=0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.002=0.001
σ1.198-1.191=0.007
min1006.431-1006.434=-0.003
max1012.026-1011.996=0.030
mean1063.200-1056.100=7.100
σ314.381-309.038=5.343
min594.000-580.000=14.000
max1627.000-1654.000=-27.000
mean1.537-1.530=0.007
σ0.054-0.072=-0.018
min1.481-1.438=0.044
max1.647-1.751=-0.103

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.410-0.426=-0.016
σ0.125-0.137=-0.012
min0.326-0.347=-0.020
max0.629-0.670=-0.041
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.890-0.900=-0.010
σ0.083-0.091=-0.008
min0.826-0.835=-0.009
max1.035-1.059=-0.024
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.534-0.543=-0.008
σ0.051-0.045=0.006
min0.493-0.510=-0.018
max0.617-0.619=-0.002
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.839-0.859=-0.020
σ0.043-0.033=0.010
min0.813-0.835=-0.022
max0.913-0.915=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.835-964.840=-0.004
σ0.029-0.035=-0.005
min964.811-964.810=0.001
max964.886-964.897=-0.010
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.825-0.857=-0.033
σ0.033-0.007=0.026
min0.787-0.852=-0.065
max0.862-0.870=-0.008
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.005-0.007=-0.002
min885.504-885.505=-0.001
max885.517-885.522=-0.006
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.700-0.732=-0.032
σ0.034-0.024=0.010
min0.664-0.690=-0.025
max0.737-0.747=-0.010

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=-0.000
min7.715
max7.722-7.721=0.001
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean4.206-4.282=-0.075
σ0.075-0.088=-0.012
min4.087-4.142=-0.055
max4.498-4.817=-0.319
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean4.203-4.253=-0.051
σ0.077-0.084=-0.007
min4.042-4.111=-0.069
max4.493-4.517=-0.024
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.751-0.752=-0.001
σ0.023-0.017=0.006
min0.632-0.718=-0.086
max0.852-0.844=0.008
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.655-0.714=-0.059
σ0.087-0.015=0.072
min0.493-0.682=-0.189
max0.779-0.781=-0.003

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.802-296.846=-0.044
σ0.269-0.224=0.046
min296.611-296.660=-0.049
max297.550-297.454=0.096
mean1907.000-1945.000=-38.000
σ0.000
min1907.000-1945.000=-38.000
max1907.000-1945.000=-38.000
mean0.586-0.574=0.011
σ0.039-0.034=0.004
min0.522-0.524=-0.002
max0.658-0.644=0.014

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.827-286.825=0.002
σ0.037-0.036=0.001
min286.778-286.779=-0.001
max286.869-286.868=0.001
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.398-0.400=-0.002
σ0.004-0.005=-0.001
min0.390-0.390=0.000
max0.401-0.404=-0.002
iters=5
new-facts=1
prior-facts=6402
mean1297.276-1297.224=0.052
σ0.107-0.063=0.044
min1297.143-1297.152=-0.009
max1297.418-1297.291=0.127
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean2.224-2.047=0.176
σ0.094-0.091=0.003
min2.063-1.962=0.101
max2.302-2.161=0.141
iters=5
new-facts=6402
prior-facts=1
mean1541.356-1541.327=0.028
σ6.814-6.838=-0.024
min1538.178-1538.105=0.073
max1553.543-1553.556=-0.014
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean2.273-2.247=0.025
σ0.187-0.203=-0.016
min2.109-2.060=0.050
max2.578-2.541=0.037
iters=5
new-facts=6402
prior-facts=6402
mean1859.114-1859.115=-0.001
σ0.066-0.078=-0.012
min1859.027-1859.004=0.022
max1859.191-1859.195=-0.004
mean1775.200-1793.000=-17.800
σ132.485-146.224=-13.739
min1627.000-1654.000=-27.000
max1907.000-1945.000=-38.000
mean3.042-2.986=0.055
σ0.185-0.100=0.085
min2.873-2.850=0.023
max3.293-3.106=0.187

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.322-1.210=0.112
σ0.288-0.360=-0.073
min1.078-0.939=0.139
max1.778-1.774=0.004

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.820-448.820=0.000
σ581.372-581.373=-0.000
min158.131-158.130=0.001
max1320.879-1320.878=0.000
mean96.250
σ8.500
min92.000
max109.000
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean0.543-0.547=-0.005
σ0.557-0.555=0.002
min0.260-0.266=-0.006
max1.378-1.380=-0.002
policies=20
mean1581.628-1581.611=0.017
σ0.365-0.358=0.007
min1581.380-1581.371=0.009
max1582.170-1582.144=0.026
mean920.000
σ0.000
min920.000
max920.000
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean2.637-2.630=0.007
σ0.013-0.016=-0.002
min2.624-2.607=0.016
max2.654-2.641=0.013
policies=200
mean15824.180-15824.249=-0.069
σ0.093-0.135=-0.042
min15824.075-15824.083=-0.008
max15824.294-15824.403=-0.110
mean9200.000
σ0.000
min9200.000
max9200.000
mean1627.000-1654.000=-27.000
σ0.000
min1627.000-1654.000=-27.000
max1627.000-1654.000=-27.000
mean26.562-26.577=-0.015
σ0.051-0.036=0.015
min26.491-26.534=-0.044
max26.612-26.623=-0.011