Compare commits

Home / Compare 953e5294 .. ca449d68

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.055-54.054=0.001
σ0.369-0.370=-0.001
min53.909-53.904=0.005
max55.105-55.106=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.142-0.138=0.003
σ0.004-0.005=-0.002
min0.137-0.132=0.006
max0.147-0.149=-0.002
cache=y
dps=1
iters=10
policies=100
mean43.393-43.393=-0.000
σ0.006-0.007=-0.001
min43.388-43.384=0.004
max43.406-43.407=-0.001
mean416.000
σ0.000
min416.000
max416.000
mean0.122-0.123=-0.000
σ0.004-0.004=-0.000
min0.118-0.118=0.000
max0.129-0.129=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1007.004-1007.002=0.002
σ1.201-1.185=0.016
min1006.435-1006.433=0.003
max1012.043-1011.971=0.073
mean1053.300-1043.700=9.600
σ307.772-305.592=2.180
min579.000-589.000=-10.000
max1646.000-1630.000=16.000
mean1.542-1.549=-0.006
σ0.079-0.096=-0.016
min1.475-1.454=0.022
max1.773-1.797=-0.024

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.427-0.417=0.010
σ0.155-0.128=0.027
min0.339-0.350=-0.011
max0.703-0.645=0.058
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.893-0.884=0.009
σ0.093-0.093=-0.000
min0.824-0.822=0.003
max1.053-1.048=0.005
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.536-0.561=-0.025
σ0.050-0.066=-0.016
min0.494-0.495=-0.001
max0.620-0.640=-0.020
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.853-0.852=0.001
σ0.041-0.045=-0.004
min0.820-0.814=0.006
max0.924-0.926=-0.002

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.839-964.840=-0.000
σ0.035-0.033=0.002
min964.809-964.812=-0.003
max964.896-964.894=0.002
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.834-0.823=0.012
σ0.030-0.033=-0.004
min0.789-0.783=0.007
max0.861-0.855=0.006
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=-0.001
σ0.007-0.007=-0.000
min885.506-885.504=0.001
max885.523-885.522=0.001
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.727-0.733=-0.006
σ0.034-0.010=0.023
min0.669-0.718=-0.049
max0.749-0.743=0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=-0.000
σ0.002-0.002=-0.000
min7.715
max7.721-7.721=0.000
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean4.267-4.182=0.085
σ0.123-0.068=0.055
min4.111-4.063=0.048
max5.154-4.409=0.745
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean4.234-4.178=0.056
σ0.078-0.123=-0.045
min4.106-3.296=0.810
max4.565-4.552=0.013
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.750-0.751=-0.001
σ0.017-0.028=-0.011
min0.711-0.711=0.001
max0.855-0.935=-0.081
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.717-0.710=0.007
σ0.019-0.028=-0.009
min0.593-0.507=0.086
max0.768-0.800=-0.031

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean297.044-296.744=0.301
σ0.184-0.206=-0.022
min296.883-296.614=0.269
max297.522-297.317=0.205
mean1962.000-1956.000=6.000
σ0.000
min1962.000-1956.000=6.000
max1962.000-1956.000=6.000
mean0.598-0.582=0.017
σ0.041-0.038=0.003
min0.553-0.510=0.043
max0.706-0.636=0.070

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean286.819-286.819=-0.001
σ0.040-0.036=0.003
min286.765-286.769=-0.004
max286.862-286.855=0.007
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.396-0.395=0.001
σ0.007-0.006=0.001
min0.388-0.388=-0.001
max0.402-0.403=-0.001
iters=5
new-facts=1
prior-facts=6402
mean1297.280-1297.253=0.027
σ0.071-0.079=-0.007
min1297.200-1297.166=0.034
max1297.377-1297.343=0.034
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean2.230-2.102=0.128
σ0.070-0.077=-0.007
min2.159-2.004=0.154
max2.335-2.195=0.140
iters=5
new-facts=6402
prior-facts=1
mean1541.336-1541.306=0.030
σ6.811-6.832=-0.021
min1538.117-1538.072=0.045
max1553.516-1553.523=-0.007
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean2.203-2.162=0.041
σ0.072-0.071=0.001
min2.132-2.062=0.070
max2.322-2.248=0.075
iters=5
new-facts=6402
prior-facts=6402
mean1859.117-1859.111=0.007
σ0.068-0.081=-0.014
min1859.035-1858.989=0.046
max1859.194-1859.185=0.009
mean1798.000-1789.400=8.600
σ158.569-163.199=-4.630
min1646.000-1630.000=16.000
max1962.000-1956.000=6.000
mean2.977-2.996=-0.019
σ0.138-0.113=0.025
min2.831-2.858=-0.028
max3.171-3.150=0.021

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.207-1.251=-0.044
σ0.354-0.309=0.045
min0.929-1.060=-0.130
max1.750-1.785=-0.035

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean448.822-448.821=0.001
σ581.372-581.372=-0.001
min158.135-158.133=0.002
max1320.880-1320.879=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean0.529-0.556=-0.028
σ0.529-0.584=-0.055
min0.262-0.261=0.002
max1.322-1.432=-0.110
policies=20
mean1581.626-1581.615=0.010
σ0.353-0.355=-0.002
min1581.389-1581.374=0.015
max1582.151-1582.143=0.008
mean920.000
σ0.000
min920.000
max920.000
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean2.635-2.635=-0.000
σ0.011-0.014=-0.002
min2.621-2.621=0.000
max2.644-2.653=-0.009
policies=200
mean15824.174-15824.040=0.135
σ0.161-0.174=-0.013
min15824.055-15823.871=0.185
max15824.411-15824.283=0.127
mean9200.000
σ0.000
min9200.000
max9200.000
mean1646.000-1630.000=16.000
σ0.000
min1646.000-1630.000=16.000
max1646.000-1630.000=16.000
mean26.637-26.609=0.028
σ0.063-0.057=0.007
min26.574-26.554=0.020
max26.725-26.658=0.067