Compare commits

Home / Compare c5b376f8 .. cabc27ee

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.015-54.016=-0.001
σ0.368-0.370=-0.002
min53.880-53.871=0.008
max55.063-55.068=-0.005
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.140-0.140=-0.000
σ0.005-0.005=0.000
min0.131-0.135=-0.004
max0.147-0.148=-0.001
cache=y
dps=1
iters=10
policies=100
mean43.322-43.323=-0.000
σ0.007-0.006=0.001
min43.313-43.315=-0.002
max43.335-43.338=-0.002
mean415.000-414.000=1.000
σ0.000
min415.000-414.000=1.000
max415.000-414.000=1.000
mean0.122-0.123=-0.001
σ0.004-0.004=-0.000
min0.116-0.120=-0.004
max0.128-0.132=-0.004

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.305=0.004
σ1.167-1.188=-0.021
min1005.742-1005.768=-0.026
max1011.194-1011.289=-0.095
mean1056.200-1045.950=10.250
σ318.261-311.597=6.664
min566.000-572.000=-6.000
max1634.000-1639.000=-5.000
mean1.536-1.543=-0.007
σ0.077-0.087=-0.009
min1.455-1.459=-0.004
max1.785-1.741=0.044

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.425-0.423=0.002
σ0.153-0.159=-0.006
min0.340-0.329=0.012
max0.698-0.706=-0.008
name=error_case.art
mean2.337
σ0.003
min2.336
max2.341
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.920-0.918=0.001
σ0.153-0.154=-0.001
min0.834-0.836=-0.002
max1.192-1.192=0.000
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.559-0.552=0.008
σ0.058-0.055=0.003
min0.515-0.510=0.005
max0.661-0.648=0.012
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.864-0.855=0.009
σ0.040-0.036=0.004
min0.832-0.823=0.010
max0.934-0.916=0.018

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.114-964.115=-0.001
σ0.020-0.032=-0.013
min964.099-964.086=0.013
max964.148-964.167=-0.019
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.815-0.818=-0.003
σ0.041-0.020=0.020
min0.755-0.804=-0.049
max0.851-0.852=-0.001
name=cdr_enhanced_4k_loc.art
mean884.710-884.712=-0.001
σ0.007-0.008=-0.001
min884.705-884.703=0.001
max884.722-884.722=-0.000
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.701-0.727=-0.026
σ0.054-0.026=0.028
min0.616-0.681=-0.065
max0.740-0.747=-0.006

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.715=-0.000
σ0.002-0.002=-0.000
min7.714
max7.718
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean4.251-3.525=0.725
σ0.074-0.086=-0.011
min4.130-3.375=0.756
max4.673-3.844=0.829
name=record_render_large_syntax_err.art
mean7.663-7.663=0.000
σ0.002-0.002=0.000
min7.662
max7.668-7.666=0.002
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean4.222-3.499=0.723
σ0.057-0.069=-0.013
min4.086-3.378=0.709
max4.384-3.722=0.662
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.737-0.742=-0.005
σ0.020-0.017=0.003
min0.703-0.714=-0.011
max0.863-0.852=0.011
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.695-0.627=0.068
σ0.015-0.103=-0.088
min0.668-0.490=0.179
max0.775-0.835=-0.060

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.336-296.365=-0.028
σ0.156-0.242=-0.086
min296.163-296.181=-0.018
max296.728-297.026=-0.297
mean1914.000-1917.000=-3.000
σ0.000
min1914.000-1917.000=-3.000
max1914.000-1917.000=-3.000
mean0.571-0.561=0.011
σ0.061-0.059=0.001
min0.498-0.497=0.001
max0.697-0.693=0.004

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.697-284.693=0.003
σ0.039-0.036=0.002
min284.644-284.644=-0.000
max284.736-284.732=0.004
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.406-0.400=0.006
σ0.006-0.010=-0.004
min0.401-0.390=0.011
max0.415-0.411=0.004
iters=5
new-facts=1
prior-facts=6402
mean1295.079-1295.081=-0.001
σ0.106-0.109=-0.003
min1294.958-1294.962=-0.004
max1295.206-1295.216=-0.010
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean1.906-1.912=-0.007
σ0.087-0.097=-0.010
min1.821-1.804=0.017
max2.034-2.005=0.029
iters=5
new-facts=6402
prior-facts=1
mean1537.931-1537.932=-0.002
σ4.050-4.055=-0.006
min1535.914-1535.899=0.015
max1545.169-1545.178=-0.009
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean2.278-2.274=0.003
σ0.272-0.247=0.025
min2.036-1.988=0.048
max2.673-2.528=0.145
iters=5
new-facts=6402
prior-facts=6402
mean1856.986-1856.987=-0.002
σ0.055-0.055=-0.000
min1856.929-1856.936=-0.007
max1857.068-1857.070=-0.002
mean1770.800-1774.800=-4.000
σ138.518-137.718=0.800
min1634.000-1639.000=-5.000
max1914.000-1917.000=-3.000
mean3.041-3.010=0.030
σ0.302-0.310=-0.009
min2.793-2.694=0.099
max3.559-3.523=0.036

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.174-1.201=-0.027
σ0.258-0.301=-0.043
min0.928-0.938=-0.010
max1.544-1.695=-0.152

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean446.125-446.124=0.001
σ577.891-577.890=0.001
min157.176-157.177=-0.002
max1312.962-1312.960=0.002
mean96.250
σ8.500
min92.000
max109.000
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean0.516-0.540=-0.024
σ0.510-0.561=-0.051
min0.261-0.258=0.002
max1.281-1.381=-0.100
policies=20
mean1572.103-1572.098=0.005
σ0.359-0.363=-0.003
min1571.860-1571.855=0.005
max1572.638-1572.637=0.000
mean920.000
σ0.000
min920.000
max920.000
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean2.629-2.635=-0.006
σ0.002-0.026=-0.024
min2.627-2.607=0.020
max2.631-2.658=-0.027
policies=200
mean15728.991-15729.075=-0.084
σ0.117-0.071=0.045
min15728.895-15729.006=-0.111
max15729.147-15729.156=-0.008
mean9200.000
σ0.000
min9200.000
max9200.000
mean1634.000-1639.000=-5.000
σ0.000
min1634.000-1639.000=-5.000
max1634.000-1639.000=-5.000
mean26.696-26.688=0.008
σ0.303-0.272=0.031
min26.489-26.546=-0.057
max27.133-27.096=0.036