Compare commits

Home / Compare 46fcfbc0 .. d88510fe

grey: no significant change wrt stddev
red: change exceeding max stddev
purple: some change, not seemingly significant

Aggregation: measureAggregations

Factorallocated MiBpeak allocated MiBtime_s
cache=n
dps=1
iters=10
policies=100
mean54.057-54.061=-0.004
σ0.369-0.368=0.002
min53.915-53.918=-0.003
max55.108-55.107=0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.141-0.156=-0.015
σ0.003-0.008=-0.004
min0.138-0.139=-0.001
max0.147-0.166=-0.020
cache=y
dps=1
iters=10
policies=100
mean43.394-43.395=-0.000
σ0.007-0.006=0.001
min43.383-43.384=-0.001
max43.407-43.408=-0.001
mean414.000-417.000=-3.000
σ0.000
min414.000-417.000=-3.000
max414.000-417.000=-3.000
mean0.121-0.121=0.000
σ0.004-0.005=-0.001
min0.116-0.114=0.002
max0.128-0.131=-0.003

Marine Hull: transactPolicy

Factorallocated MiBpeak allocated MiBtime
datapoints=1
iterations=20
mean1006.922-1006.922=-0.000
σ0.886-0.891=-0.005
min1006.454-1006.436=0.018
max1010.595-1010.623=-0.029
mean1050.850-1054.850=-4.000
σ315.826-315.991=-0.165
min545.000-548.000=-3.000
max1626.000-1629.000=-3.000
mean1.530-1.530=-0.000
σ0.074-0.065=0.009
min1.423-1.447=-0.025
max1.769-1.689=0.080

Parser: Comma Sep

Factorallocated MiBpeak allocated MiBtime (ms)
name=ambiguous_item.art
mean0.883
σ0.003
min0.882
max0.887
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.404-0.416=-0.013
σ0.093-0.141=-0.048
min0.352-0.336=0.016
max0.568-0.665=-0.097
name=error_case.art
mean2.339
σ0.003
min2.337
max2.342
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.893-0.887=0.006
σ0.088-0.112=-0.024
min0.833-0.820=0.013
max1.046-1.084=-0.037
name=heavy_item.art
mean1.524
σ0.002
min1.522
max1.526
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.532-0.525=0.007
σ0.048-0.059=-0.011
min0.487-0.472=0.015
max0.611-0.621=-0.010
name=nested_use.art
mean2.361
σ0.002
min2.360
max2.364
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.843-0.841=0.002
σ0.045-0.040=0.006
min0.809-0.802=0.006
max0.921-0.906=0.015

Parser: Real World

Factorallocated MiBpeak allocated MiBtime (sec)
name=aon_gpf25_7k_loc.art
mean964.840-964.840=-0.001
σ0.035-0.033=0.001
min964.809-964.813=-0.004
max964.897-964.895=0.002
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.822-0.788=0.034
σ0.027-0.055=-0.028
min0.800-0.743=0.057
max0.852-0.861=-0.009
name=cdr_enhanced_4k_loc.art
mean885.512-885.512=0.000
σ0.007-0.007=0.000
min885.504
max885.522-885.521=0.001
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.704-0.708=-0.004
σ0.025-0.028=-0.002
min0.664-0.666=-0.002
max0.728-0.732=-0.003

Parser: Record Parsing

Factorallocated MiBpeak allocated MiBtime (ms)
name=record_render_large_success.art
mean7.716-7.716=0.000
σ0.002-0.002=0.000
min7.715
max7.721-7.721=-0.000
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean4.232-4.242=-0.010
σ0.079-0.094=-0.015
min4.063-4.075=-0.012
max4.507-4.655=-0.148
name=record_render_large_syntax_err.art
mean7.665
σ0.002
min7.664
max7.668
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean4.189-4.239=-0.049
σ0.069-0.081=-0.013
min4.029-4.044=-0.015
max4.482-4.490=-0.008
name=record_render_success.art
mean2.291
σ0.002
min2.290
max2.294
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.736-0.653=0.083
σ0.018-0.104=-0.086
min0.704-0.508=0.196
max0.841-0.846=-0.005
name=record_render_syntax_err.art
mean2.166
σ0.002
min2.165
max2.169
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.699-0.498=0.201
σ0.029-0.013=0.016
min0.510-0.475=0.035
max0.786-0.577=0.210

SoV import

Factorallocated MiBpeak allocated MiBtime_s
iters=10
rows=1000
mean295.627-295.305=0.322
σ0.215-0.233=-0.018
min295.482-295.126=0.356
max296.213-295.944=0.270
mean1904.000-1896.000=8.000
σ0.000
min1904.000-1896.000=8.000
max1904.000-1896.000=8.000
mean0.566-0.587=-0.021
σ0.051-0.046=0.005
min0.498-0.514=-0.016
max0.681-0.680=0.001

Workflow: transactPolicy

Factorallocated MiBpeak allocated MiBtime
iters=5
new-facts=1
prior-facts=1
mean285.356-285.365=-0.009
σ0.037-0.037=-0.000
min285.303-285.317=-0.014
max285.395-285.406=-0.010
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.387-0.390=-0.003
σ0.009-0.007=0.002
min0.380-0.382=-0.002
max0.399-0.396=0.002
iters=5
new-facts=1
prior-facts=6402
mean1295.731-1295.736=-0.005
σ0.120-0.104=0.016
min1295.597-1295.624=-0.027
max1295.926-1295.863=0.063
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean2.006-1.927=0.079
σ0.215-0.102=0.113
min1.807-1.822=-0.014
max2.283-2.055=0.227
iters=5
new-facts=6402
prior-facts=1
mean1539.885-1539.899=-0.015
σ6.795-6.811=-0.016
min1536.695-1536.582=0.113
max1552.037-1552.077=-0.040
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean2.273-2.396=-0.123
σ0.156-0.259=-0.104
min2.102-2.017=0.084
max2.438-2.657=-0.219
iters=5
new-facts=6402
prior-facts=6402
mean1857.657-1857.645=0.012
σ0.055-0.067=-0.012
min1857.597-1857.565=0.032
max1857.733-1857.735=-0.003
mean1770.400-1765.000=5.400
σ130.692-127.285=3.407
min1626.000-1629.000=-3.000
max1904.000-1896.000=8.000
mean3.104-3.044=0.059
σ0.275-0.223=0.051
min2.861-2.891=-0.030
max3.570-3.432=0.138

newProductH/cdr_auton/broker

Factortime_s
iterations=5
mean1.243-1.242=0.001
σ0.278-0.335=-0.057
min1.060-0.949=0.111
max1.719-1.806=-0.087

policy addition benchmark

Factorallocated MiBdb queriespeak allocated MiBtime
policies=2
mean445.490-445.488=0.001
σ580.640-580.641=-0.000
min155.165-155.166=-0.001
max1316.450-1316.449=0.001
mean96.250
σ8.500
min92.000
max109.000
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean0.508-0.540=-0.032
σ0.501-0.563=-0.062
min0.256-0.257=-0.001
max1.260-1.385=-0.125
policies=20
mean1551.944-1551.931=0.014
σ0.317-0.317=-0.000
min1551.728-1551.711=0.017
max1552.415-1552.401=0.014
mean920.000
σ0.000
min920.000
max920.000
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean2.568-2.573=-0.005
σ0.013-0.015=-0.002
min2.557-2.561=-0.004
max2.585-2.593=-0.008
policies=200
mean15527.578-15527.641=-0.063
σ0.175-0.106=0.069
min15527.473-15527.500=-0.027
max15527.838-15527.741=0.097
mean9200.000
σ0.000
min9200.000
max9200.000
mean1626.000-1629.000=-3.000
σ0.000
min1626.000-1629.000=-3.000
max1626.000-1629.000=-3.000
mean26.022-26.110=-0.088
σ0.143-0.129=0.014
min25.921-25.992=-0.071
max26.234-26.295=-0.061