Changes to support sharrow on 2-zone model by jpn-- · Pull Request #867 · ActivitySim/activitysim

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn-- · 2024-05-06T22:37:44Z

This PR has a number of changes made in support of sharrow on the new "canonical" 2-zone example, although as it turns out none of these changes really alter how ActivitySim runs...

Add land_use_columns_orig setting to aggregate accessibility, to allow joins against both destination (previously available) and origin (new) land use attributes without convoluted hacks in the spec.
Add omx_ignore_patterns to State.settings, which allows us to ignore loading certain skim tables, either because they are problematic or just to save memory.
Update the minimum version for sharrow to 2.9.1 (for omx_ignore_patterns) and numba to 0.57 (to access np.nan_to_num as a numba function).
Improve runtime logging of sharrow and non-sharrow code to disambiguate interaction-simulate steps from simulate steps.
Improve debugging script that is activated in interaction-simulate steps only in sharrow test mode, when sharrow and non-sharrow utility functions differ.
Cleanly close opened OMX files instead of leaving open file handles lingering to be closed when Python shuts down.
Documentation updates
Change to test configs for joint_tour_frequency_composition to correct math errors in the model spec.

…e/activitysim into trip_dest_alts_preprocess

…fix-all

dhensle · 2024-05-20T19:09:21Z

+ This is useful if you have tables in your OMX file that you don't want to
+ read in. For example, if you have both time-of-day values and time-independent
+ values (e.g., "BIKE_TIME" and "BIKE_TIME__AM"), you can ignore the time-of-day
+ values by setting this to ["BIKE_TIME__.+"].


Is this required for sharrow? If so, I think we need to put an assert statement in the skim read for sharrow somewhere that will prevent this from happening and provide some info to the user about the error.

Yes, not for sharrow per se, but the SkimDataset converts all the by-time-of-day skim variables into three dimensional arrays (o,d,time). So without this, in the example the OMX files essentially have two different sets of data for the same named variable, one two-dimension BIKE_TIME, and one three-dimension BIKE_TIME, which coincidentally happens to have no variance across the temporal dimension. We can't have two variables in the same namespace with the same name, so one is overwritten.

Opened an issue #873 to address this.

…fix-all

…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

jpn--and others added 30 commits April 23, 2024 11:08

test external regional model examples
915e8d7

cache buster
3038256

optional variable doc
3bdc1a4

fix conda cache dirs
b876e9c

Merge branch 'main' into external-regions
f578e72

Merge branch 'main' into external-regions
9c282f0

Merge branch 'main' into external-regions
e41054f

trip_destination alts preprocessor
6438f59

non_hh_veh cat, drop unused cols for alts
33097eb

blacken
a61b2d5

adding missed alts columns used in xborder model
4c4a9d9

remove unneeded addition to categorical
6cb139b

clearer time logging
0fa0269

bump required numba to 0.57 for np.nan_to_num
35a57d4

sharrow docs
5ea7362

use compute_setting in sharrow debugging
ac2468f

fix comment
97ff87b

debug helper values
26aef51

dtype compute fixes
16fc8e2

land_use_columns_orig
75d1a1d

fix and test orig_land_use with explicit chunking
11a01a7

repair
5eb076a

add missing test result file
0c7221a

omx_ignore_patterns
b7b7244

revert change to drop size terms
17826ed

Merge branch 'main' into trip_dest_alts_preprocess
96483c0

creating separate sample and simulate preprocessors
077b8a1

Merge branch 'trip_dest_alts_preprocess' ofhttps://github.com/dhensl…
bd03050
…e/activitysim into trip_dest_alts_preprocess

bugfix
b911f1f

skim_dataset loading without dask
3cabeda

jpn-- added 5 commits May 13, 2024 16:37

require sharrow 2.9
0016ea5

Merge branch 'trip_dest_alts_preprocess' into sharrow-fix-all
ee5b8cc

wait to close open files
e630edf

require sharrow 2.9.1
2607029

Merge commit '564c4762944d3288097eb4ef761bdbdb0f9d4d9f' into sharrow-…
f1ee710
…fix-all

jpn-- mentioned this pull request May 14, 2024
Sharrow fix all ActivitySim/sandag-abm3-example#15
Merged

jpn-- requested review from dhensle and i-am-sijia May 14, 2024 17:39

i-am-sijia reviewed May 15, 2024
View reviewed changes

Comment threadconda-environments/docbuild.yml

dhensle mentioned this pull request May 16, 2024
Full Scale Performance: Single Process, Sharrow Off ActivitySim/sandag-abm3-example#7
Open

landuse index sort before sharrow recode check
96d4bb6

dhensle reviewed May 20, 2024
View reviewed changes

jpn-- added 5 commits May 21, 2024 16:44

decode time periods
79a1a0a

use original tazs where possible
0bfa915

Merge branch 'main' into external-regions
79cd6a2

Merge commit '79cd6a2544c4162469057e99b6ec327f3f362306' into sharrow-…
d02a709
…fix-all

update numba in envs to 0.57
a551bfa

This was referenced May 22, 2024
External regions #858
Closed
Skim variables input checker #873
Closed

jpn--and others added 7 commits May 22, 2024 16:10

Merge branch 'main' into sharrow-fix-all
93ed2df

no fastmath in tour mode choice
d98f776

sharrow cache by version
b465dd0

include sharrow setting in log by defualt
fe13e93

Merge commit 'bd48d3db3624a20771095cf3252549eb10315375' into sharrow-…
2f260f2
…fix-all # Conflicts: # conda-environments/docbuild.yml # pyproject.toml

use dask if required
fcf7295

store_skims_in_shm setting
c9d4205

dhensle mentioned this pull request Jun 24, 2024
Full Scale Performance: Sharrow On ActivitySim/activitysim-prototype-mtc#12
Open

jpn-- merged commit 28a0ad0 into ActivitySim:mainJul 3, 2024

jpn-- mentioned this pull request May 12, 2025
Skim name conflicts #939
Merged

Uh oh!

Conversation

jpn-- commented May 6, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

jpn-- commented May 6, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

jpn-- commented May 6, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Uh oh!

Conversation

jpn-- commented May 6, 2024• edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

jpn-- commented May 6, 2024•
edited
Loading

jpn-- commented May 6, 2024•
edited
Loading

jpn-- commented May 6, 2024•
edited
Loading

jpn-- commented May 6, 2024•
edited
Loading

jpn-- commented May 6, 2024•
edited
Loading

jpn-- commented May 6, 2024•
edited
Loading