Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0
, 'i'); if (__m === '*' || __re.test(location.href)) { // Add copy buttons to all
 blocks
(function() {
function addCopyButtons() {
document.querySelectorAll('pre code').forEach(function(codeBlock) {
if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;
codeBlock.parentElement.setAttribute('data-copy-added', 'true');
var btn = document.createElement('button');
btn.textContent = 'Copy';
btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';
btn.onmouseover = function() { this.style.opacity = '1'; };
btn.onmouseout = function() { this.style.opacity = '0.7'; };
btn.onclick = function() {
navigator.clipboard.writeText(codeBlock.textContent).then(function() {
btn.textContent = 'Copied!';
setTimeout(function() { btn.textContent = 'Copy'; }, 1500);
});
};
codeBlock.parentElement.style.position = 'relative';
codeBlock.parentElement.appendChild(btn);
});
}
addCopyButtons();
// Re-run on dynamic content
var observer = new MutationObserver(addCopyButtons);
observer.observe(document.body, { childList: true, subtree: true });
})();
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
fix: Fix per-file config interaction with one py_binary per main by adzenith · Pull Request #1664 · bazel-contrib/rules_python · GitHub
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0
, 'i'); if (__m === '*' || __re.test(location.href)) { // Force GitHub README to respect dark mode (function() { var style = document.createElement('style'); style.textContent = ' .markdown-body { color-scheme: dark light; } .markdown-body pre { background: #161b22 !important; } .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; } .markdown-body table th, .markdown-body table td { border-color: #30363d !important; } .markdown-body img { background: #0d1117; } .markdown-body blockquote { border-left-color: #8b949e; } .markdown-body hr { border-color: #30363d; } '; document.head.appendChild(style); })(); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix: Fix per-file config interaction with one py_binary per main by adzenith · Pull Request #1664 · bazel-contrib/rules_python · GitHub
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0
, 'i'); if (__m === '*' || __re.test(location.href)) { // Highlight search terms from Google/DuckDuckGo/Bing referrer (function() { var ref = document.referrer; var terms = []; if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) { var url = new URL(ref); var q = url.searchParams.get('q') || url.searchParams.get('p'); if (q) { terms = q.split(/\s+/).filter(function(t) { return t.length > 2; }); } } if (terms.length === 0) return; var style = document.createElement('style'); style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }'; document.head.appendChild(style); function highlight(node) { if (node.nodeType === 3) { // text node var text = node.textContent; var found = false; terms.forEach(function(term) { var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\]\\]/g, '\\') + ')', 'gi'); if (regex.test(text)) { found = true; var frag = document.createDocumentFragment(); var parts = text.split(regex); parts.forEach(function(part, i) { if (i % 2 === 0) { frag.appendChild(document.createTextNode(part)); } else { var span = document.createElement('span'); span.className = 'userscript-highlight'; span.textContent = part; frag.appendChild(span); } }); node.parentNode.replaceChild(frag, node); } }); } else if (node.nodeType === 1 && node.childNodes) { // element var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT']; if (!skipTags.includes(node.tagName)) { Array.from(node.childNodes).forEach(highlight); } } } highlight(document.body); // Re-highlight on dynamic content var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1 || node.nodeType === 3) highlight(node); }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix: Fix per-file config interaction with one py_binary per main by adzenith · Pull Request #1664 · bazel-contrib/rules_python · GitHub
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0
, 'i'); if (__m === '*' || __re.test(location.href)) { // Strip utm_, fbclid, gclid, etc. from all links on page (function() { var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content', 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid', 'ref', 'ref_src', 'source', 'medium', 'campaign']; function cleanUrl(url) { try { var u = new URL(url, window.location.origin); var changed = false; trackingParams.forEach(function(p) { if (u.searchParams.has(p)) { u.searchParams.delete(p); changed = true; } }); return changed ? u.toString() : url; } catch (e) { return url; } } function cleanLinks() { document.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } cleanLinks(); var observer = new MutationObserver(function(mutations) { mutations.forEach(function(m) { m.addedNodes.forEach(function(node) { if (node.nodeType === 1) { if (node.tagName === 'A') cleanLinks(); node.querySelectorAll('a[href]').forEach(function(a) { var clean = cleanUrl(a.href); if (clean !== a.href) a.href = clean; }); } }); }); }); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + ' fix: Fix per-file config interaction with one py_binary per main by adzenith · Pull Request #1664 · bazel-contrib/rules_python · GitHub
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0
, 'i'); if (__m === '*' || __re.test(location.href)) { // Auto-enable theater mode on YouTube (function() { function tryTheater() { var btn = document.querySelector('button[aria-label="Theater mode"], ytd-player #player button[title="Theater mode"]'); if (btn && !btn.classList.contains('activated')) { btn.click(); } } // Try immediately tryTheater(); // Try after navigation (SPA) var lastUrl = location.href; setInterval(function() { if (location.href !== lastUrl) { lastUrl = location.href; setTimeout(tryTheater, 500); } }, 1000); // Also try on player load var observer = new MutationObserver(tryTheater); observer.observe(document.body, { childList: true, subtree: true }); })(); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix: Fix per-file config interaction with one py_binary per main by adzenith · Pull Request #1664 · bazel-contrib/rules_python · GitHub
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0
, 'i'); if (__m === '*' || __re.test(location.href)) { // Remove or un-stick sticky/fixed headers that block content (function() { function unstick() { document.querySelectorAll('header, nav, [role="banner"], .header, .navbar, .sticky, .fixed-top, [style*="position: fixed"], [style*="position:sticky"]').forEach(function(el) { if (el.style.position === 'fixed' || el.style.position === 'sticky' || getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') { el.style.position = 'static'; el.style.top = 'auto'; el.style.zIndex = 'auto'; } }); } unstick(); var observer = new MutationObserver(unstick); observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] }); })(); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + ' fix: Fix per-file config interaction with one py_binary per main by adzenith · Pull Request #1664 · bazel-contrib/rules_python · GitHub
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0
, 'i'); if (__m === '*' || __re.test(location.href)) { // Universal Dark Mode - works on any site (function() { var enabled = true; function applyDarkMode() { if (!enabled) return; // Create style element if it doesn't exist var style = document.getElementById('universal-dark-mode-style'); if (!style) { style = document.createElement('style'); style.id = 'universal-dark-mode-style'; document.head.appendChild(style); } // Dark mode CSS - inverts colors but preserves images/video style.textContent = ' /* Invert everything except media */ html { filter: invert(1) hue-rotate(180deg) !important; background: #1a1a2e !important; } /* Restore images, videos, iframes, canvas */ img, video, iframe, canvas, svg, picture, [style*="background-image"] { filter: invert(1) hue-rotate(180deg) !important; } /* Preserve specific elements that should not be inverted */ .no-dark-mode, .no-dark-mode *, [data-theme="light"], [data-theme="light"], .ace_editor, .ace_editor *, .CodeMirror, .CodeMirror *, .monaco-editor, .monaco-editor *, .markdown-body pre, .markdown-body pre *, .highlight, .highlight *, pre code, pre code * { filter: none !important; } /* Fix common UI elements */ .modal, .popup, .dropdown-menu, .tooltip, .popover { filter: invert(1) hue-rotate(180deg) !important; background: #2d2d44 !important; border-color: #444 !important; } /* Scrollbars */ ::-webkit-scrollbar { background: #1a1a2e !important; } ::-webkit-scrollbar-thumb { background: #444 !important; } ::-webkit-scrollbar-thumb:hover { background: #555 !important; } /* Selection */ ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; } ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; } '; } function removeDarkMode() { var style = document.getElementById('universal-dark-mode-style'); if (style) style.remove(); } // Toggle with Alt+Shift+D document.addEventListener('keydown', function(e) { if (e.altKey && e.shiftKey && e.key === 'D') { e.preventDefault(); enabled = !enabled; if (enabled) { applyDarkMode(); console.log('[Universal Dark Mode] Enabled'); } else { removeDarkMode(); console.log('[Universal Dark Mode] Disabled'); } } }); // Apply on load applyDarkMode(); // Re-apply on dynamic content var observer = new MutationObserver(function(mutations) { if (enabled && !document.getElementById('universal-dark-mode-style')) { applyDarkMode(); } }); observer.observe(document.head, { childList: true }); console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle'); })(); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })(); fix: Fix per-file config interaction with one py_binary per main by adzenith · Pull Request #1664 · bazel-contrib/rules_python · GitHub
Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
4 changes: 4 additions & 0 deletions CHANGELOG.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -40,6 +40,10 @@ A brief description of the categories of changes:
* (toolchains) `py_runtime` can now take an executable target. Note: runfiles
from the target are not supported yet.

* (gazelle) When `python_generation_mode` is set to `file`, create one `py_binary`
target for each file with `if __name__ == "__main__"` instead of just one
`py_binary` for the whole module.

### Fixed

* (gazelle) The gazelle plugin helper was not working with Python toolchains 3.11
Expand Down
16 changes: 14 additions & 2 deletions gazelle/README.md
Original file line numberDiff line numberDiff line change
Expand Up@@ -250,8 +250,20 @@ When no such entry point exists, Gazelle will look for a line like this in the t
if __name == "__main__":
```

Gazelle will create `py_binary` target will be created for every module with such line, with the target name
being the same as module name.
Gazelle will create a `py_binary` target for every module with such a line, with
the target name the same as the module name.

If `python_generation_mode` is set to `file`, then instead of one `py_binary`
target per module, Gazelle will create one `py_binary` target for each file with
such a line, and the name of the target will match the name of the script.

Note that it's possible for another script to depend on a `py_binary` target and
import from the `py_binary`'s scripts. This can have possible negative effects on
Bazel analysis time and runfiles size compared to depending on a `py_library`
target. The simplest way to avoid these negative effects is to extract library
code into a separate script without a `main` line. Gazelle will then create a
`py_library` target for that library code, and other scripts can depend on that
`py_library` target.

## Developer Notes

Expand Down
35 changes: 23 additions & 12 deletions gazelle/python/generate.go
Original file line numberDiff line numberDiff line change
Expand Up@@ -225,23 +225,17 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
log.Fatalf("ERROR: %v\n", err)
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

if !hasPyBinaryEntryPointFile {
// Creating one py_binary target per main module when __main__.py doesn't exist.
mainFileNames := make([]string, 0, len(mainModules))
for name := range mainModules {
mainFileNames = append(mainFileNames, name)

// Remove the file from srcs if we're doing per-file library generation so
// that we don't also generate a py_library target for it.
if cfg.PerFileGeneration() {
srcs.Remove(name)
}
}
sort.Strings(mainFileNames)
for _, filename := range mainFileNames {
Expand All@@ -262,6 +256,23 @@ func (py *Python) GenerateRules(args language.GenerateArgs) language.GenerateRes
}
}

// If we're doing per-file generation, srcs could be empty at this point, meaning we shouldn't make a py_library.
if srcs.Empty() {
return
}

// Check if a target with the same name we are generating already
// exists, and if it is of a different kind from the one we are
// generating. If so, we have to throw an error since Gazelle won't
// generate it correctly.
if err := ensureNoCollision(args.File, pyLibraryTargetName, actualPyLibraryKind); err != nil {
fqTarget := label.New("", args.Rel, pyLibraryTargetName)
err := fmt.Errorf("failed to generate target %q of kind %q: %w. "+
"Use the '# gazelle:%s' directive to change the naming convention.",
fqTarget.String(), actualPyLibraryKind, err, pythonconfig.LibraryNamingConvention)
collisionErrors.Add(err)
}

pyLibrary := newTargetBuilder(pyLibraryKind, pyLibraryTargetName, pythonProjectRoot, args.Rel, pyFileNames).
addVisibility(visibility).
addSrcs(srcs).
Expand Down
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,46 @@
load("@rules_python//python:defs.bzl", "py_binary", "py_library")

# gazelle:python_generation_mode file

# gazelle:resolve py numpy @pip//:numpy
# gazelle:resolve py pandas @pip//:pandas

py_library(
name = "lib",
srcs = ["lib.py"],
visibility = ["//:__subpackages__"],
deps = [
"@pip//:numpy",
"@pip//:pandas",
],
)

py_library(
name = "lib2",
srcs = ["lib2.py"],
visibility = ["//:__subpackages__"],
deps = [
":lib",
":lib_and_main",
],
)

py_binary(
name = "lib_and_main",
srcs = ["lib_and_main.py"],
visibility = ["//:__subpackages__"],
)

py_binary(
name = "main",
srcs = ["main.py"],
visibility = ["//:__subpackages__"],
deps = ["@pip//:pandas"],
)

py_binary(
name = "main2",
srcs = ["main2.py"],
visibility = ["//:__subpackages__"],
deps = [":lib2"],
)
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
# Binary without entrypoint

This test case asserts that when there is no __main__.py, a py_binary is generated per file main module, and that this
py_binary is instead of (not in addition to) any py_library target.
Comment thread
aignas marked this conversation as resolved.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1 @@
# This is a Bazel workspace for the Gazelle test data.
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import numpy
import pandas
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,2 @@
import lib
import lib_and_main
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,6 @@
def library_func():
print("library_func")


if __name__ == "__main__":
library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import pandas

if __name__ == "__main__":
run()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,4 @@
import lib2

if __name__ == "__main__":
lib2.lib_and_main.library_func()
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,17 @@
# Copyright 2023 The Bazel Authors. All rights reserved.
#
# Licensed under the Apache License, Version 2.0 (the "License");
# you may not use this file except in compliance with the License.
# You may obtain a copy of the License at
#
# http://www.apache.org/licenses/LICENSE-2.0
#
# Unless required by applicable law or agreed to in writing, software
# distributed under the License is distributed on an "AS IS" BASIS,
# WITHOUT WARRANTIES OR CONDITIONS OF ANY KIND, either express or implied.
# See the License for the specific language governing permissions and
# limitations under the License.

---
expect:
exit_code: 0