Compare commits

Home / Compare b9d0d100 .. 38c88db9

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.016-54.017=-0.001
σ0.370-0.370=-0.000
min53.873-53.875=-0.002
max55.067-55.068=-0.002
mean420.000-417.000=3.000
σ0.000
min420.000-417.000=3.000
max420.000-417.000=3.000
mean0.138-0.143=-0.005
σ0.004-0.008=-0.003
min0.132-0.138=-0.005
max0.147-0.159=-0.012
cache=y
dps=1
iters=10
policies=100
mean43.323-43.322=0.001
σ0.006-0.006=0.001
min43.315-43.314=0.001
max43.337-43.333=0.004
mean420.000-417.000=3.000
σ0.000
min420.000-417.000=3.000
max420.000-417.000=3.000
mean0.123-0.122=0.001
σ0.004-0.004=-0.000
min0.119-0.118=0.001
max0.128-0.130=-0.001

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.309-1006.304=0.005
σ1.175-1.195=-0.020
min1005.766-1005.765=0.002
max1011.232-1011.313=-0.081
mean1060.850-1047.300=13.550
σ317.599-312.582=5.016
min571.000-598.000=-27.000
max1637.000-1641.000=-4.000
mean1.560-1.572=-0.011
σ0.070-0.088=-0.017
min1.472-1.473=-0.001
max1.740-1.829=-0.089

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.866
σ0.003
min0.864
max0.869
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.408-0.416=-0.008
σ0.144-0.132=0.012
min0.317-0.331=-0.014
max0.663-0.645=0.018
name=error_case.art
mean2.337-2.338=-0.001
σ0.003-0.004=-0.001
min2.336
max2.341-2.344=-0.002
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.877-0.927=-0.050
σ0.093-0.171=-0.078
min0.801-0.825=-0.024
max1.036-1.229=-0.194
name=heavy_item.art
mean1.523
σ0.002
min1.522
max1.526
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.551-0.548=0.003
σ0.047-0.053=-0.006
min0.514-0.509=0.004
max0.632-0.640=-0.009
name=nested_use.art
mean2.360
σ0.002
min2.359
max2.363
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.849-0.856=-0.007
σ0.038-0.034=0.004
min0.817-0.827=-0.010
max0.914-0.914=0.001

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.113-964.113=-0.001
σ0.030-0.020=0.010
min964.087-964.095=-0.007
max964.163-964.145=0.018
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.824-0.827=-0.003
σ0.047-0.016=0.031
min0.744-0.810=-0.066
max0.860-0.852=0.008
name=cdr_enhanced_4k_loc.art
mean884.711-884.713=-0.001
σ0.008-0.006=0.001
min884.703-884.705=-0.001
max884.723-884.723=-0.000
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.722-0.723=-0.000
σ0.026-0.035=-0.009
min0.680-0.661=0.019
max0.742-0.750=-0.009

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.715-7.714=0.000
σ0.002-0.002=0.000
min7.714
max7.719-7.718=0.001
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean4.310-4.239=0.071
σ0.076-0.080=-0.003
min4.190-4.051=0.139
max4.680-4.578=0.102
name=record_render_large_syntax_err.art
mean7.663-7.663=-0.000
σ0.002-0.002=-0.000
min7.662
max7.666
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean4.338-4.253=0.084
σ0.097-0.087=0.009
min4.199-4.138=0.061
max4.605-4.591=0.014
name=record_render_success.art
mean2.289
σ0.002
min2.289
max2.292
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.743-0.736=0.007
σ0.016-0.022=-0.006
min0.713-0.654=0.058
max0.853-0.865=-0.012
name=record_render_syntax_err.art
mean2.165
σ0.002
min2.164
max2.168
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.706-0.704=0.002
σ0.013-0.013=-0.001
min0.681-0.670=0.010
max0.770-0.750=0.020

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean296.450-296.136=0.314
σ0.277-0.196=0.081
min296.177-295.948=0.229
max297.144-296.636=0.508
mean1905.000-1912.000=-7.000
σ0.000
min1905.000-1912.000=-7.000
max1905.000-1912.000=-7.000
mean0.580-0.581=-0.001
σ0.039-0.023=0.015
min0.518-0.523=-0.005
max0.621-0.603=0.018

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean284.696-284.702=-0.006
σ0.044-0.029=0.015
min284.644-284.667=-0.023
max284.749-284.737=0.012
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.401-0.397=0.004
σ0.012-0.010=0.002
min0.387-0.386=0.001
max0.417-0.405=0.012
iters=5
new-facts=1
prior-facts=6402
mean1295.076-1295.076=0.001
σ0.110-0.105=0.006
min1294.952-1294.960=-0.008
max1295.223-1295.204=0.019
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean1.891-1.923=-0.032
σ0.073-0.119=-0.045
min1.808-1.789=0.019
max1.954-2.042=-0.088
iters=5
new-facts=6402
prior-facts=1
mean1539.205-1539.181=0.024
σ6.847-6.864=-0.017
min1535.958-1535.942=0.016
max1551.451-1551.457=-0.006
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean2.161-2.263=-0.102
σ0.148-0.245=-0.097
min2.020-2.065=-0.045
max2.399-2.536=-0.137
iters=5
new-facts=6402
prior-facts=6402
mean1856.988-1856.989=-0.001
σ0.058-0.054=0.004
min1856.929-1856.929=-0.000
max1857.075-1857.066=0.009
mean1772.800-1776.400=-3.600
σ127.264-132.960=-5.695
min1637.000-1641.000=-4.000
max1905.000-1912.000=-7.000
mean3.114-3.092=0.022
σ0.342-0.350=-0.008
min2.867-2.860=0.007
max3.717-3.700=0.017

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.237-1.127=0.110
σ0.340-0.228=0.112
min0.945-0.938=0.007
max1.778-1.479=0.299

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean447.780-447.782=-0.002
σ581.204-581.203=0.000
min157.175-157.178=-0.004
max1319.585-1319.587=-0.001
mean96.250
σ8.500
min92.000
max109.000
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean0.535-0.537=-0.002
σ0.545-0.540=0.006
min0.261-0.264=-0.003
max1.353-1.346=0.007
policies=20
mean1572.100-1572.104=-0.004
σ0.366-0.356=0.010
min1571.854-1571.862=-0.007
max1572.645-1572.634=0.011
mean920.000
σ0.000
min920.000
max920.000
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean2.635-2.638=-0.003
σ0.011-0.021=-0.009
min2.619-2.610=0.009
max2.646-2.655=-0.009
policies=200
mean15728.996-15729.071=-0.074
σ0.102-0.125=-0.024
min15728.852-15728.967=-0.115
max15729.090-15729.252=-0.162
mean9200.000
σ0.000
min9200.000
max9200.000
mean1637.000-1641.000=-4.000
σ0.000
min1637.000-1641.000=-4.000
max1637.000-1641.000=-4.000
mean26.672-26.637=0.035
σ0.041-0.035=0.006
min26.616-26.588=0.027
max26.713-26.671=0.041