(pre) release for 1.3 by jpn-- · Pull Request #800 · ActivitySim/activitysim

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

jpn-- · 2024-02-14T14:25:52Z

This update offers numerous significant enhancements to how ActivitySim works, including:

Removal of ORCA. This new version of ActivitySim does not use ORCA as a dependency, and thus does not rely on ORCA’s global state to manage data. Instead, a new State class is introduced, which encapsulates the current state of a simulation including all data tables. This is a significant change “under the hood”, which may be particularly consequential for model that use “extensions” to the ActivitySim framework. Replace ORCA with non-global state #654
Pydantic for model settings. In prior versions, model settings were specifies as YAML input files and could contain arbitrary content, both for ActivitySim at a global level as well as for individual components. This update now uses Pydantic to validate settings. Config Settings and Documentation #758
Input checker. This new component allows for configuring checks on the validity of data input files. Input Checker #753
Data Type Optimization. A variety of internal data type optimization changes in Data Type Optimization #782
BayDAG Contributions in BayDAG Contributions #657

Other smaller enhancements include:

add model_settings to estimator.write_coefficients by @bwentl in add model_settings to estimator.write_coefficients #651
docs: apply a minor correction to user guides by @asiripanich in docs: apply a minor correction to user guides #659
Trip scheduling logic by @jpn-- in Trip scheduling logic #660
Pin Dependencies by @jpn-- in Pin Dependencies #665
Updated SEMCOG Example by @dhensle in Updated SEMCOG Example #603
syncronize by @jpn-- in syncronize #680
Fix memory usage by @jpn-- in Fix memory usage #751
orca residual cleanup by @jpn-- in orca residual cleanup #694
Disable unstable estimation mode test by @jpn-- in Disable unstable estimation mode test #765
Overflow protection by @jpn-- in Overflow protection #764
Fixes windows error on large MAZ systems by @jpn-- in Fixes windows error on large MAZ systems #760
update repo test pointers by @jpn-- in update repo test pointers #783
Explicit chunking by @jpn-- in Explicit chunking #759
Selecting choices from joint tour participant ID column explicitly; by @bricegnichols in Selecting choices from joint tour participant ID column explicitly; #653
Option to write output tables as parquet files by @stefancoe in Option to write output tables as parquet files #763
Moved 'tot_tours' from nm tour frequency script to alternatives file by @JoeJimFlood in Moved 'tot_tours' from nm tour frequency script to alternatives file #661
Add options to handle larger dataset for location models by @bwentl in Add options to handle larger dataset for location models #687
Pydantic 2 by @jpn-- in Pydantic 2 #796
added stricter joining of annotated fields by @nick-fournier-rsg in added stricter joining of annotated fields #672
Vehicle Type Alts Filtering Bug Fix by @dhensle in Vehicle Type Alts Filtering Bug Fix #790
Alt col name bug fix for option to handle larger dataset for location models by @bwentl in Alt col name bug fix for option to handle larger dataset for location models #798

Updated Model Component Documentation

…ctivitysim into cfg-documentation-navjs

Model Documentation Updates and minor bug fixes

documentation builds better

…vitysim into cfg-documentation-vy

…-jn-escort

Pydantic 2

added stricter joining of annotated fields

Vehicle Type Alts Filtering Bug Fix

# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

…ransLinkForecasting/activitysim into location_estimation_patch

latest updates from other PRs

Data Type Optimization

…_patch Alt col name bug fix for option to handle larger dataset for location models

Performance monitoring fixes

vivekyadav26and others added 30 commits October 31, 2023 09:14

Update telecommute_frequency.md
2d558c4

Update telecommute_frequency.md
d9e7c93

Update transit_pass_ownership.md
538f405

Update transit_pass_subsidy.md
28b3fa3

Update vehicle_type_choice.md
b0e6131

Merge branch 'cfg-documentation-vy' into cfg-documentation-navjs
d5b24dd

Merge pull request#11from camsys/cfg-documentation-navjs
200d73d
Updated Model Component Documentation

Updated documentation for joint tour compostion model
0b7efcf

Merge branch 'cfg-documentation-navjs' ofhttps://github.com/camsys/a…
42abe71
…ctivitysim into cfg-documentation-navjs

Added documentation for more models and minor bug fixes
c9615ce

Update non_mandatory_scheduling.md
5f16583

Merge pull request#12from camsys/cfg-documentation-navjs
13cfa28
Model Documentation Updates and minor bug fixes

minor edits [makedocs]
a24d8e4

verbose action [makedocs]
7f5693e

bump pytables to 3.9
26d54c6

pin autodoc_pydantic<2.0
199ae2e

[makedocs]
ff87616

escorting
fc5d9a5

Merge pull request#13from camsys/cfg-docs-jn-2
73fc620
documentation builds better

[makedocs]
b40dffc

Merge branch 'cfg-documentation-vy' ofhttps://github.com/camsys/acti…
34adea1
…vitysim into cfg-documentation-vy

minor edits [makedocs]
4f5d56d

test initialize
4be2058

test
fc17ced

AnnotateTableSettings
501430f

init tables things
86c3820

bug fixes [makedocs]
ac5ca47

Merge branch 'cfg-documentation-vy' into cfg-docs-jn-escort
8b9596c

documentation updates [makedocs]
529a4df

Merge commit '529a4df3f18c2f44d856b4339c7c391e503b7f67' into cfg-docs…
dead81a
…-jn-escort

jpn--and others added 29 commits February 8, 2024 10:28

update test to use pydantic 2
613126e

remove outdated commented code
2a72c2f

Merge pull request#796from camsys/pydantic-2
5141945
Pydantic 2

added stricter joining of annotated fields
0d69abb

lint blacked
6b3a90c

added unit test for df_from_dict indexing
a3f60a4

remove filtered alts from alts_long as well
5f18242

logging and correct order for vehicle type name
cbc3dc8

correct veh type alts indexing
70c7366

veh type alts CI test
ede2a52

blacken
3521c8d

Merge pull request#672from nick-fournier-rsg/annotate_bugfix
bdc9cac
added stricter joining of annotated fields

Merge pull request#790from ActivitySim/veh_type_alts_filter_fix
a2ad2a1
Vehicle Type Alts Filtering Bug Fix

Merge branch 'develop' into data-type-op-pd-cat
1f40c06
# Conflicts: # activitysim/abm/models/vehicle_type_choice.py

Merge branch 'data-type-op-pd-cat' into perf-fix
8bdfa0f

make coding for chunking for generic for other location models
1af9c34
- person_id is not compatible for tour and trip destination models, should use tour_id or trip_id instead - to make this variable for generic, the code will now use the first column in the alternative data file

Merge branch 'location_estimation_patch_main' ofhttps://github.com/T…
0f1e312
…ransLinkForecasting/activitysim into location_estimation_patch

Merge pull request#11from camsys/data-type-op-pd-cat
db03dae
latest updates from other PRs

Merge pull request#782from wsp-sag/data-type-op-pd-cat
1f42cd3
Data Type Optimization

install altair for devs
229bd87

Merge commit '1f42cd3659171f9e353806067859baf146f6ecbe' into perf-fix
3b8e4cd

ignore missing injectables for MP
ba30a63

external mtc-ext example
27e67ab

fix logging call warning
494f0a1

Merge pull request#798from TransLinkForecasting/location_estimation…
e2ed3a0
…_patch Alt col name bug fix for option to handle larger dataset for location models

Merge branch 'develop' into perf-fix
04d64ff

fix input_checker runtime
4a2b2f2

repair landuse check
bb01cdc

Merge pull request#797from camsys/perf-fix
5799535
Performance monitoring fixes

jpn-- merged commit c0305bd into mainFeb 14, 2024