Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 1 addition & 1 deletion .github/workflows/branch-docs.yml
Original file line numberDiff line numberDiff line change
Expand Up@@ -7,7 +7,7 @@ on:

jobs:
docbuild:
if: "contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop')"
if: "github.event_name == 'workflow_dispatch' || (contains(github.event.head_commit.message, '[makedocs]') && (github.repository_owner != 'ActivitySim') && (github.ref_name != 'develop'))"
# develop branch docs are built at the end of the core test workflow, regardless of repository owner or commit message flags
name: ubuntu-latest py3.10
runs-on: ubuntu-latest
Expand Down
1 change: 1 addition & 0 deletions docs/dev-guide/components/index.rst
Original file line numberDiff line numberDiff line change
Expand Up@@ -6,6 +6,7 @@ Components

.. toctree::
:maxdepth: 1
input_checker
initialize
initialize_los
initialize_tours
Expand Down
54 changes: 54 additions & 0 deletions docs/dev-guide/components/input_checker.md
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,54 @@
(input_checker)=
# Input Checker

The input checker is an optional model that will ensure the inputs are as expected according to the
configuration of the user. This model does not have any connection to downstream models and does not
add anything to the ActivitySim pipeline. It is intended to be run at the very start of every ActivitySim
run to quickly examine whether the input data aligns with the user's expectations.

The input checker is built on the Pandera python package. Users are responsible for writing the
Pandera code that will perform the checks they would like to be performed. By allowing the user to
write python code, they are provided with maximum flexiblity to check their input data. (Pydantic
was also explored as a potential technology choice for input checker implementation. Pydantic
development got as far as performing checks and outputting errors, but further development around
reporting warnings and more in-depth testing was dropped in favor of the Pandera approach. The
in-development code has remained as-is in the repository in the event future data model development
favors this approach.)

If any checks fail, ActivitySim will crash and direct you to the output input_checker.log file which
will provide details of the checks that did not pass. The user can also setup checks to output
warnings instead of fatal errors. Warning details will be output to the input_checker.log file for
user review and documentation. Syntax examples for both errors and warnings are demonstrated in the
[`prototype_mtc_extended`] and [`production_semcog`] examples.

Setup steps for new users:
* Copy the data_model directory in the [`prototype_mtc_extended`] or
[`production_semcog`] example folder to your setup space. You will need the enums.py and
input_checks.py scripts. The additional input_checks_pydantic_dev.py script in
[`prototype_mtc_extended`] is there for future development and can be discarded.
* Modify the input_checker.py to be consistent with your input data. This can include changing
variable names and adding or removing checks. The amount and types of checks to perform are
completely up to you! Syntax is shown for many different checks in the example.
* Modify enums.py to be consistent with your implesmentation by changing / adding / removing variable
definitions.
* Copy the input_checker.yaml script from [`prototype_mtc_extended`] or
[`production_semcog`] configs into your configs
directory. Update the list of data tables you would like to check in the input_checker.yaml
file. The "validator_class" option should correspond to the name of the corresponding class in
the input_checker.py file you modified in the above step.
* Add the input_checker model to the models option in your settings.yaml file to include it in the
model run. When running activitysim, you will also need to include the name of the data_model
directory from the first step, e.g. activitysim run -c configs -d data -o outout --data_model
data_model.

```{note}
If you are running ActivitySim with the input checker module active, you must supply
a --data_model argument that points to where the input_checks.py file exists!
```

## Implementation

```{eval-rst}
.. automodule:: activitysim.abm.models.input_checker
:members:
```