Compare commits

Home / Compare c158ebee .. c0ee6292

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.367-0.370=-0.003
min53.909-53.904=0.005
max55.100-55.106=-0.006
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.141-0.138=0.003
σ0.004-0.005=-0.001
min0.138-0.132=0.006
max0.149-0.149=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.394-43.393=0.001
σ0.007-0.007=-0.000
min43.385-43.384=0.001
max43.410-43.407=0.003
mean420.000-416.000=4.000
σ0.000
min420.000-416.000=4.000
max420.000-416.000=4.000
mean0.123-0.123=0.000
σ0.004-0.004=-0.000
min0.120-0.118=0.002
max0.129-0.129=-0.000

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.005-1007.002=0.003
σ1.201-1.185=0.016
min1006.459-1006.433=0.027
max1012.038-1011.971=0.067
mean1055.250-1043.700=11.550
σ307.841-305.592=2.249
min580.000-589.000=-9.000
max1647.000-1630.000=17.000
mean1.551-1.549=0.002
σ0.086-0.096=-0.009
min1.418-1.454=-0.035
max1.783-1.797=-0.014

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.884-0.883=0.000
σ0.002-0.003=-0.000
min0.882
max0.887
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.419-0.417=0.002
σ0.132-0.128=0.004
min0.347-0.350=-0.003
max0.654-0.645=0.010
name=error_case.art
mean2.339-2.339=0.001
σ0.003-0.003=0.000
min2.337
max2.342-2.342=0.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.895-0.884=0.011
σ0.104-0.093=0.010
min0.827-0.822=0.006
max1.076-1.048=0.028
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.544-0.561=-0.017
σ0.052-0.066=-0.014
min0.505-0.495=0.010
max0.632-0.640=-0.008
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.890-0.852=0.039
σ0.060-0.045=0.014
min0.834-0.814=0.020
max0.977-0.926=0.051

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.834-964.840=-0.005
σ0.030-0.033=-0.002
min964.810-964.812=-0.003
max964.886-964.894=-0.008
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.828-0.823=0.005
σ0.042-0.033=0.008
min0.760-0.783=-0.023
max0.857-0.855=0.002
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.000
σ0.004-0.007=-0.003
min885.505-885.504=0.001
max885.516-885.522=-0.006
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.721-0.733=-0.012
σ0.038-0.010=0.027
min0.654-0.718=-0.065
max0.740-0.743=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean4.249-4.182=0.066
σ0.096-0.068=0.028
min4.111-4.063=0.048
max4.769-4.409=0.360
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean4.209-4.178=0.030
σ0.068-0.123=-0.056
min4.081-3.296=0.785
max4.443-4.552=-0.109
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.744-0.751=-0.007
σ0.017-0.028=-0.011
min0.716-0.711=0.005
max0.851-0.935=-0.084
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.701-0.710=-0.010
σ0.019-0.028=-0.009
min0.662-0.507=0.156
max0.795-0.800=-0.005

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.003-296.744=0.259
σ0.258-0.206=0.052
min296.849-296.614=0.235
max297.709-297.317=0.392
mean1904.000-1956.000=-52.000
σ0.000
min1904.000-1956.000=-52.000
max1904.000-1956.000=-52.000
mean0.591-0.582=0.009
σ0.039-0.038=0.001
min0.539-0.510=0.029
max0.679-0.636=0.043

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.828-286.819=0.008
σ0.038-0.036=0.001
min286.781-286.769=0.012
max286.873-286.855=0.018
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.401-0.395=0.006
σ0.009-0.006=0.003
min0.391-0.388=0.003
max0.412-0.403=0.009
iters=5
new-facts=1
prior-facts=6402
mean1297.273-1297.253=0.020
σ0.081-0.079=0.003
min1297.197-1297.166=0.030
max1297.388-1297.343=0.044
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean2.198-2.102=0.096
σ0.080-0.077=0.002
min2.067-2.004=0.063
max2.261-2.195=0.066
iters=5
new-facts=6402
prior-facts=1
mean1541.337-1541.306=0.031
σ6.833-6.832=0.001
min1538.121-1538.072=0.049
max1553.558-1553.523=0.035
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean2.221-2.162=0.058
σ0.132-0.071=0.061
min2.112-2.062=0.050
max2.393-2.248=0.145
iters=5
new-facts=6402
prior-facts=6402
mean1859.112-1859.111=0.002
σ0.067-0.081=-0.015
min1859.033-1858.989=0.044
max1859.193-1859.185=0.008
mean1781.000-1789.400=-8.400
σ125.178-163.199=-38.021
min1647.000-1630.000=17.000
max1904.000-1956.000=-52.000
mean3.097-2.996=0.101
σ0.321-0.113=0.208
min2.754-2.858=-0.104
max3.532-3.150=0.382

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.293-1.251=0.042
σ0.316-0.309=0.007
min0.938-1.060=-0.122
max1.745-1.785=-0.040

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.821-448.821=0.000
σ581.371-581.372=-0.002
min158.133-158.133=0.000
max1320.877-1320.879=-0.002
mean96.250
σ8.500
min92.000
max109.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean0.552-0.556=-0.005
σ0.579-0.584=-0.005
min0.260-0.261=-0.001
max1.420-1.432=-0.012
policies=20
mean1581.616-1581.615=0.001
σ0.338-0.355=-0.017
min1581.388-1581.374=0.014
max1582.119-1582.143=-0.024
mean920.000
σ0.000
min920.000
max920.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean2.634-2.635=-0.001
σ0.013-0.014=-0.001
min2.621-2.621=-0.000
max2.649-2.653=-0.004
policies=200
mean15824.167-15824.040=0.127
σ0.102-0.174=-0.073
min15824.034-15823.871=0.164
max15824.260-15824.283=-0.023
mean9200.000
σ0.000
min9200.000
max9200.000
mean1647.000-1630.000=17.000
σ0.000
min1647.000-1630.000=17.000
max1647.000-1630.000=17.000
mean26.706-26.609=0.097
σ0.117-0.057=0.060
min26.616-26.554=0.063
max26.868-26.658=0.210