Uh oh!
There was an error while loading. Please reload this page.
YARN-8246 winutils - fix failure to retrieve disk and network perf co… - #458
Closed
pgoron wants to merge 1 commit into
Closed
YARN-8246 winutils - fix failure to retrieve disk and network perf co…#458pgoron wants to merge 1 commit into
pgoron wants to merge 1 commit into
Conversation
…unters on localized windows installlation PdhAddCounter expects performance counter path to be in the same language than the windows installation. With current code, the calls to PdhAddCounter will fail with error 0xc0000bb8 (PDH_CSTATUS_NO_OBJECT) on non-english windows installation. The solution is to use PdhAddEnglishCounter function instead https://docs.microsoft.com/en-us/windows/desktop/api/pdh/nf-pdh-pdhaddenglishcounterw "This function provides a language-neutral way to add performance counters to the query"
jiwq
reviewed
Apr 2, 2019
| // Add each one of the counters with wild cards | ||
| if(status = PdhAddCounter(hQuery, COUNTER_PATH_NET_READ_ALL, 0, &hCounterNetRead)) | ||
| if(status = PdhAddEnglishCounter(hQuery, COUNTER_PATH_NET_READ_ALL, 0, &hCounterNetRead)) |
Member
There was a problem hiding this comment.
Suggested change
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_NET_READ_ALL, 0, &hCounterNetRead)) | |
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_NET_READ_ALL, 0, &hCounterNetRead)) |
| goto cleanup; | ||
| } | ||
| if(status = PdhAddCounter(hQuery, COUNTER_PATH_NET_WRITE_ALL, 0, &hCounterNetWrite)) | ||
| if(status = PdhAddEnglishCounter(hQuery, COUNTER_PATH_NET_WRITE_ALL, 0, &hCounterNetWrite)) |
Member
There was a problem hiding this comment.
Suggested change
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_NET_WRITE_ALL, 0, &hCounterNetWrite)) | |
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_NET_WRITE_ALL, 0, &hCounterNetWrite)) |
| goto cleanup; | ||
| } | ||
| if(status = PdhAddCounter(hQuery, COUNTER_PATH_DISK_READ_ALL, 0, &hCounterDiskRead)) | ||
| if(status = PdhAddEnglishCounter(hQuery, COUNTER_PATH_DISK_READ_ALL, 0, &hCounterDiskRead)) |
Member
There was a problem hiding this comment.
Suggested change
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_DISK_READ_ALL, 0, &hCounterDiskRead)) | |
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_DISK_READ_ALL, 0, &hCounterDiskRead)) |
| goto cleanup; | ||
| } | ||
| if(status = PdhAddCounter(hQuery, COUNTER_PATH_DISK_WRITE_ALL, 0, &hCounterDiskWrite)) | ||
| if(status = PdhAddEnglishCounter(hQuery, COUNTER_PATH_DISK_WRITE_ALL, 0, &hCounterDiskWrite)) |
Member
There was a problem hiding this comment.
Suggested change
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_DISK_WRITE_ALL, 0, &hCounterDiskWrite)) | |
| if(status=PdhAddEnglishCounter(hQuery, COUNTER_PATH_DISK_WRITE_ALL, 0, &hCounterDiskWrite)) |
pgoron
commented
Apr 4, 2019
Author
Hi jiwq, If I do the suggested format change, it will make the formatting inconsistent with the rest of file (there are plenty of "if" not followed by space in the rest of the file). I would prefer not mixing a functional change with a formatting change. Peter |
jiwq
commented
Apr 4, 2019
Member
Hi @pgoron , I'm okay. |
hadoop-yetus
commented
Jul 19, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Jul 26, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Aug 2, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Aug 8, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Aug 16, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Aug 20, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Aug 22, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Aug 27, 2019
💔 -1 overall
This message was automatically generated. |
hadoop-yetus
commented
Sep 3, 2019
💔 -1 overall
This message was automatically generated. |
shanthoosh pushed a commit
to shanthoosh/hadoop
that referenced
this pull request
Oct 15, 2019
…ducer Refactoring eventhub system producer into common reusable components 1. AsyncSystemProducer : All the system producers that have real async send API with call backs can use this 2. NoFlushAsyncSystemProducer: All the system producers that have real async call back based send API and doesn't provide flush semantics can use this. The system producers that implement AsyncSystemproducers can be used across Samza and Brooklin. TODO: AsyncSystemProducer needs to be moved to the api layer so that it can be used across different system producers (i.e. eventhub and kinesis) Author: Srinivasulu Punuru <spunuru@linkedin.com> Reviewers: Boris S <boryas@apache.org> Closesapache#458 from srinipunuru/async-prod.3
gianlucastrada
commented
Mar 9, 2020
but where I use this function? I've the same problem to start hadoop: ExitCodeException exitCode=1: PdhAddCounter \Network Interface(*)\Bytes Received/Sec failed with 0xc0000bb8 Please help me! |
NyteKnight pushed a commit
to NyteKnight/hadoop
that referenced
this pull request
Jun 25, 2024
NyteKnight pushed a commit
to NyteKnight/hadoop
that referenced
this pull request
Jun 25, 2024
…-76130 (apache#491) * Revert "[hadoop] LIHADOOP-76132 : Evolve the BundledTokenIdentifier to include SPIFFE tokens (apache#458)" This reverts commit e3d76d0. * Revert "[hadoop] LIHADOOP-76131 : Create the SPIFFE Delegation Token Identifier (apache#456)" This reverts commit df81929. * Revert "[hadoop] LIHADOOP-76130: Update BundledDelegationTokenIdentifier to have unambiguous serde (apache#457)" This reverts commit 902ba08.
singer-bin pushed a commit
to singer-bin/hadoop
that referenced
this pull request
Dec 19, 2024
In parquet-format every value in Statistics is optional while parquet-mr does not properly handle these scenarios: - null_count is set but min/max or min_value/max_value are not: filtering may fail with NPE or incorrect filtering occurs fix: check if min/max is set before comparing to the related values - null_count is not set: filtering handles null_count as if it would be 0 -> incorrect filtering may occur fix: introduce new method in Statistics object to check if num_nulls is set; check if num_nulls is set by the new method before using its value for filtering Author: Gabor Szadovszky <gabor.szadovszky@cloudera.com> Closesapache#458 from gszadovszky/PARQUET-1217 and squashes the following commits: 9d14090 [Gabor Szadovszky] Updates according to rdblue's comments 116d1d3 [Gabor Szadovszky] PARQUET-1217: Updates according to zi's comments c264b50 [Gabor Szadovszky] PARQUET-1217: fix handling of unset nullCount 2ec2fb1 [Gabor Szadovszky] PARQUET-1217: Incorrect handling of missing values in Statistics
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for freeto join this conversation on GitHub.
Already have an account?
Sign in to comment
6 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
…unters on localized windows installlation.
PdhAddCounter expects performance counter path to be in the same language than the windows installation.
With current code, the calls to PdhAddCounter will fail with error 0xc0000bb8 (PDH_CSTATUS_NO_OBJECT)
on non-english windows installation.
The solution is to use PdhAddEnglishCounter function instead
https://docs.microsoft.com/en-us/windows/desktop/api/pdh/nf-pdh-pdhaddenglishcounterw
"This function provides a language-neutral way to add performance counters to the query"