feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Add copy buttons to all
 blocks\n(function() {\n function addCopyButtons() {\n document.querySelectorAll('pre code').forEach(function(codeBlock) {\n if (codeBlock.parentElement.hasAttribute('data-copy-added')) return;\n codeBlock.parentElement.setAttribute('data-copy-added', 'true');\n \n var btn = document.createElement('button');\n btn.textContent = 'Copy';\n btn.style.cssText = 'position:absolute;top:4px;right:4px;padding:2px 8px;font-size:11px;background:#4ecdc4;border:none;border-radius:4px;color:#1a1a2e;cursor:pointer;opacity:0.7;transition:opacity 0.2s;';\n btn.onmouseover = function() { this.style.opacity = '1'; };\n btn.onmouseout = function() { this.style.opacity = '0.7'; };\n btn.onclick = function() {\n navigator.clipboard.writeText(codeBlock.textContent).then(function() {\n btn.textContent = 'Copied!';\n setTimeout(function() { btn.textContent = 'Copy'; }, 1500);\n });\n };\n codeBlock.parentElement.style.position = 'relative';\n codeBlock.parentElement.appendChild(btn);\n });\n }\n \n addCopyButtons();\n \n // Re-run on dynamic content\n var observer = new MutationObserver(addCopyButtons);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Add Copy Buttons to Code Blocks");
}
} catch(__e) { console.warn('[Userscript:Add Copy Buttons to Code Blocks]', __e); }
})();
(function(){
try {
var __m = "github.com";
var __re = new RegExp('^' + "github\\.com" + '
Skip to content

feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Force GitHub README to respect dark mode\n(function() {\n var style = document.createElement('style');\n style.textContent = '\n .markdown-body {\n color-scheme: dark light;\n }\n .markdown-body pre { background: #161b22 !important; }\n .markdown-body code { background: rgba(110, 118, 129, 0.4) !important; }\n .markdown-body table th, .markdown-body table td { border-color: #30363d !important; }\n .markdown-body img { background: #0d1117; }\n .markdown-body blockquote { border-left-color: #8b949e; }\n .markdown-body hr { border-color: #30363d; }\n ';\n document.head.appendChild(style);\n})();", "GitHub Dark Mode README Fix"); } } catch(__e) { console.warn('[Userscript:GitHub Dark Mode README Fix]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Highlight search terms from Google/DuckDuckGo/Bing referrer\n(function() {\n var ref = document.referrer;\n var terms = [];\n \n if (ref.includes('google.com') || ref.includes('duckduckgo.com') || ref.includes('bing.com')) {\n var url = new URL(ref);\n var q = url.searchParams.get('q') || url.searchParams.get('p');\n if (q) {\n terms = q.split(/\\s+/).filter(function(t) { return t.length > 2; });\n }\n }\n \n if (terms.length === 0) return;\n \n var style = document.createElement('style');\n style.textContent = '.userscript-highlight { background: #fbbf24; color: #1a1a2e; padding: 1px 3px; border-radius: 2px; }';\n document.head.appendChild(style);\n \n function highlight(node) {\n if (node.nodeType === 3) { // text node\n var text = node.textContent;\n var found = false;\n terms.forEach(function(term) {\n var regex = new RegExp('(' + term.replace(/[.*+?^${}()|[\\]\\\\]/g, '\\\\') + ')', 'gi');\n if (regex.test(text)) {\n found = true;\n var frag = document.createDocumentFragment();\n var parts = text.split(regex);\n parts.forEach(function(part, i) {\n if (i % 2 === 0) {\n frag.appendChild(document.createTextNode(part));\n } else {\n var span = document.createElement('span');\n span.className = 'userscript-highlight';\n span.textContent = part;\n frag.appendChild(span);\n }\n });\n node.parentNode.replaceChild(frag, node);\n }\n });\n } else if (node.nodeType === 1 && node.childNodes) { // element\n var skipTags = ['SCRIPT', 'STYLE', 'NOSCRIPT', 'TEXTAREA', 'INPUT', 'SELECT'];\n if (!skipTags.includes(node.tagName)) {\n Array.from(node.childNodes).forEach(highlight);\n }\n }\n }\n \n highlight(document.body);\n \n // Re-highlight on dynamic content\n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1 || node.nodeType === 3) highlight(node);\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Highlight Search Terms"); } } catch(__e) { console.warn('[Userscript:Highlight Search Terms]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Strip utm_, fbclid, gclid, etc. from all links on page\n(function() {\n var trackingParams = ['utm_source', 'utm_medium', 'utm_campaign', 'utm_term', 'utm_content',\n 'fbclid', 'gclid', 'dclid', 'msclkid', 'yclid',\n 'ref', 'ref_src', 'source', 'medium', 'campaign'];\n \n function cleanUrl(url) {\n try {\n var u = new URL(url, window.location.origin);\n var changed = false;\n trackingParams.forEach(function(p) {\n if (u.searchParams.has(p)) {\n u.searchParams.delete(p);\n changed = true;\n }\n });\n return changed ? u.toString() : url;\n } catch (e) {\n return url;\n }\n }\n \n function cleanLinks() {\n document.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n \n cleanLinks();\n \n var observer = new MutationObserver(function(mutations) {\n mutations.forEach(function(m) {\n m.addedNodes.forEach(function(node) {\n if (node.nodeType === 1) {\n if (node.tagName === 'A') cleanLinks();\n node.querySelectorAll('a[href]').forEach(function(a) {\n var clean = cleanUrl(a.href);\n if (clean !== a.href) a.href = clean;\n });\n }\n });\n });\n });\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "Remove Tracking Parameters from Links"); } } catch(__e) { console.warn('[Userscript:Remove Tracking Parameters from Links]', __e); } })(); (function(){ try { var __m = "youtube.com"; var __re = new RegExp('^' + "youtube\\.com" + '
Skip to content

feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Auto-enable theater mode on YouTube\n(function() {\n function tryTheater() {\n var btn = document.querySelector('button[aria-label=\"Theater mode\"], ytd-player #player button[title=\"Theater mode\"]');\n if (btn && !btn.classList.contains('activated')) {\n btn.click();\n }\n }\n \n // Try immediately\n tryTheater();\n \n // Try after navigation (SPA)\n var lastUrl = location.href;\n setInterval(function() {\n if (location.href !== lastUrl) {\n lastUrl = location.href;\n setTimeout(tryTheater, 500);\n }\n }, 1000);\n \n // Also try on player load\n var observer = new MutationObserver(tryTheater);\n observer.observe(document.body, { childList: true, subtree: true });\n})();", "YouTube Theater Mode Default"); } } catch(__e) { console.warn('[Userscript:YouTube Theater Mode Default]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Remove or un-stick sticky/fixed headers that block content\n(function() {\n function unstick() {\n document.querySelectorAll('header, nav, [role=\"banner\"], .header, .navbar, .sticky, .fixed-top, [style*=\"position: fixed\"], [style*=\"position:sticky\"]').forEach(function(el) {\n if (el.style.position === 'fixed' || el.style.position === 'sticky' || \n getComputedStyle(el).position === 'fixed' || getComputedStyle(el).position === 'sticky') {\n el.style.position = 'static';\n el.style.top = 'auto';\n el.style.zIndex = 'auto';\n }\n });\n }\n \n unstick();\n \n var observer = new MutationObserver(unstick);\n observer.observe(document.body, { childList: true, subtree: true, attributes: true, attributeFilter: ['style', 'class'] });\n})();", "Kill Sticky Headers"); } } catch(__e) { console.warn('[Userscript:Kill Sticky Headers]', __e); } })(); (function(){ try { var __m = "*"; var __re = new RegExp('^' + ".*" + '
Skip to content

feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953
, 'i'); if (__m === '*' || __re.test(location.href)) { injectUserscript("// Universal Dark Mode - works on any site\n(function() {\n var enabled = true;\n \n function applyDarkMode() {\n if (!enabled) return;\n \n // Create style element if it doesn't exist\n var style = document.getElementById('universal-dark-mode-style');\n if (!style) {\n style = document.createElement('style');\n style.id = 'universal-dark-mode-style';\n document.head.appendChild(style);\n }\n \n // Dark mode CSS - inverts colors but preserves images/video\n style.textContent = '\n /* Invert everything except media */\n html {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #1a1a2e !important;\n }\n \n /* Restore images, videos, iframes, canvas */\n img, video, iframe, canvas, svg, picture, [style*=\"background-image\"] {\n filter: invert(1) hue-rotate(180deg) !important;\n }\n \n /* Preserve specific elements that should not be inverted */\n .no-dark-mode, .no-dark-mode *,\n [data-theme=\"light\"], [data-theme=\"light\"],\n .ace_editor, .ace_editor *,\n .CodeMirror, .CodeMirror *,\n .monaco-editor, .monaco-editor *,\n .markdown-body pre, .markdown-body pre *,\n .highlight, .highlight *,\n pre code, pre code * {\n filter: none !important;\n }\n \n /* Fix common UI elements */\n .modal, .popup, .dropdown-menu, .tooltip, .popover {\n filter: invert(1) hue-rotate(180deg) !important;\n background: #2d2d44 !important;\n border-color: #444 !important;\n }\n \n /* Scrollbars */\n ::-webkit-scrollbar { background: #1a1a2e !important; }\n ::-webkit-scrollbar-thumb { background: #444 !important; }\n ::-webkit-scrollbar-thumb:hover { background: #555 !important; }\n \n /* Selection */\n ::selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ::-moz-selection { background: #4ecdc4 !important; color: #1a1a2e !important; }\n ';\n }\n \n function removeDarkMode() {\n var style = document.getElementById('universal-dark-mode-style');\n if (style) style.remove();\n }\n \n // Toggle with Alt+Shift+D\n document.addEventListener('keydown', function(e) {\n if (e.altKey && e.shiftKey && e.key === 'D') {\n e.preventDefault();\n enabled = !enabled;\n if (enabled) {\n applyDarkMode();\n console.log('[Universal Dark Mode] Enabled');\n } else {\n removeDarkMode();\n console.log('[Universal Dark Mode] Disabled');\n }\n }\n });\n \n // Apply on load\n applyDarkMode();\n \n // Re-apply on dynamic content\n var observer = new MutationObserver(function(mutations) {\n if (enabled && !document.getElementById('universal-dark-mode-style')) {\n applyDarkMode();\n }\n });\n observer.observe(document.head, { childList: true });\n \n console.log('[Universal Dark Mode] Loaded - Press Alt+Shift+D to toggle');\n})();", "Universal Dark Mode"); } } catch(__e) { console.warn('[Userscript:Universal Dark Mode]', __e); } })(); })();
Skip to content

feat(feedback): Revamp of user feedback screenshot editing - #15424

Merged
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2
Feb 24, 2025
Merged

feat(feedback): Revamp of user feedback screenshot editing#15424
ryan953 merged 18 commits into
ryan953/feedback-highlight-maskfrom
cl/annotations-v2

Conversation

@c298lee

@c298leec298lee commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

DO NOT MERGE

Allows you to edit screenshots with highlight and hide boxes, with the ability to delete individual boxes and resize the page. This will replace the previous cropping and pen annotation.
image

Closesgetsentry/sentry#69786

@github-actions

github-actionsBot commented Feb 14, 2025

Copy link
Copy Markdown
Contributor

size-limit report 📦

PathSize% ChangeChange
@sentry/browser23.05 KB--
@sentry/browser - with treeshaking flags22.84 KB--
@sentry/browser (incl. Tracing)36.07 KB--
@sentry/browser (incl. Tracing, Replay)73.08 KB--
@sentry/browser (incl. Tracing, Replay) - with treeshaking flags66.55 KB--
@sentry/browser (incl. Tracing, Replay with Canvas)77.34 KB--
@sentry/browser (incl. Tracing, Replay, Feedback)89.69 KB-0.66%-608 B 🔽
@sentry/browser (incl. Feedback)39.62 KB-1.46%-600 B 🔽
@sentry/browser (incl. sendFeedback)27.68 KB-0.01%-1 B 🔽
@sentry/browser (incl. FeedbackAsync)32.46 KB-0.06%-17 B 🔽
@sentry/react24.87 KB--
@sentry/react (incl. Tracing)37.95 KB--
@sentry/vue27.23 KB--
@sentry/vue (incl. Tracing)37.76 KB--
@sentry/svelte23.09 KB--
CDN Bundle24.25 KB--
CDN Bundle (incl. Tracing)36.1 KB--
CDN Bundle (incl. Tracing, Replay)70.94 KB--
CDN Bundle (incl. Tracing, Replay, Feedback)76.1 KB-0.01%-6 B 🔽
CDN Bundle - uncompressed70.91 KB--
CDN Bundle (incl. Tracing) - uncompressed107.17 KB--
CDN Bundle (incl. Tracing, Replay) - uncompressed218.45 KB--
CDN Bundle (incl. Tracing, Replay, Feedback) - uncompressed230.99 KB-0.02%-33 B 🔽
@sentry/nextjs (client)38.94 KB--
@sentry/sveltekit (client)36.48 KB--
@sentry/node129.25 KB--
@sentry/node - without tracing98.03 KB--
@sentry/aws-serverless107.45 KB--

View base workflow run

@codecov

codecovBot commented Feb 14, 2025

Copy link
Copy Markdown

❌ 1 Tests Failed:

Tests completedFailedPassedSkipped
463814637323
View the top 1 failed test(s) by shortest run time
shouldreportANRwheneventloopblockedworkercanbestoppedandrestarted
Stack Traces | 15s run time
Error: thrown: "Exceededtimeoutof15000msforatest.
Usejest.setTimeout(newTimeout) toincreasethetimeoutvalue, ifthisisalong-runningtest."
at .../suites/anr/test.ts:204:3at_dispatchDescribe (.../jest-circus/build/index.js:98:26)
atdescribe (.../jest-circus/build/index.js:60:5)
atObject.<anonymous> (.../suites/anr/test.ts:109:1)
atRuntime._execModule (.../jest-runtime/build/index.js:1646:24)
atRuntime._loadModule (.../jest-runtime/build/index.js:1185:12)
atRuntime.requireModule (.../jest-runtime/build/index.js:1009:12)
atjestAdapter (.../build/legacy-code-todo-rewrite/jestAdapter.js:79:13)
atprocessTicksAndRejections (node:internal/process/task_queues:95:5)
atrunTestInternal (.../jest-runner/build/runTest.js:389:16)

To view more test analytics, go to the Test Analytics Dashboard
📋 Got 3 mins? Take this short survey to help us improve Test Analytics.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotInput.css.ts Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditorv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/Toolbarv2.tsx Outdated
border: var(--button-border, var(--border));
border-radius: var(--button-border-radius, 6px);
background: var(--button-background, var(--background));
color: var(--button-foreground, var(--foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I think when I added the annotation stuff, I mixed up the names and used the wrong one. This is technically not in the docs, but now it matches what's used in the form buttons


.editor__tool--active {
background: var(--button-primary-background, var(--accent-background));
color: var(--button-primary-foreground, var(--accent-foreground));

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

was this wrong before, not matching docs? now it's fixed?

Comment on lines +99 to +103
if (sentryFeedback) {
strokeColor =
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background') ||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Suggested change
if(sentryFeedback){
strokeColor=
getComputedStyle(sentryFeedback).getPropertyValue('--button-primary-background')||
getComputedStyle(sentryFeedback).getPropertyValue('--accent-background');
}
if(sentryFeedback){
constcomputedStyle=getComputedStyle(sentryFeedback);
strokeColor=
computedStyle.getPropertyValue('--button-primary-background')||
computedStyle.getPropertyValue('--accent-background');
}

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

also, not sure if this is the best way to do this, but it works

@c298lee
c298lee marked this pull request as ready for review February 21, 2025 18:36
@c298lee
c298lee requested a review from a team as a code ownerFebruary 21, 2025 18:36
@c298lee
c298lee requested a review from ryan953February 21, 2025 19:29

@billyvgbillyvg left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

mostly nits about naming/comments

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
<Annotations action={action} imageBuffer={imageBuffer} annotatingRef={annotatingRef} />
<div class="editor__canvas-container" ref={measurementRef}>
<canvas ref={screenshotRef}></canvas>
<canvas class="editor__canvas-annotate" ref={graywashRef} onMouseDown={handleMouseDown}></canvas>

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It would be nice if the class names and ref name were more aligned. Also, graywash makes me think it's only used to draw the backdrop, but handleMouseDown looks like it's also handling the drawing of the boxes/rects. maybe this doesn't matter as much if we had some code comments about what the different refs are do.

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
};

const handleMouseUp = (e: MouseEvent): void => {
setCurrentRect(undefined);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

can you add a comment why we're setting current rect as undefined?

}
}, [currentRect]);

const drawBuffer = hooks.useCallback((): void => {

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the purpose of the buffer?

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

updated with a comment

Comment threadpackages/feedback/src/screenshot/components/ScreenshotEditor.tsx Outdated
Comment on lines +136 to +144
const [drawCommands, setDrawCommands] = hooks.useState<Rect[]>([]);
const [currentRect, setCurrentRect] = hooks.useState<Rect | undefined>(undefined);
const measurementRef = hooks.useRef<HTMLDivElement>(null);
const screenshotRef = hooks.useRef<HTMLCanvasElement>(null);
const graywashRef = hooks.useRef<HTMLCanvasElement>(null);
const rectDivRef = hooks.useRef<HTMLDivElement>(null);
const [imageSource, setimageSource] = hooks.useState<HTMLCanvasElement | null>(null);
const [displayEditor, setdisplayEditor] = hooks.useState<boolean>(true);
const [scaleFactor, setScaleFactor] = hooks.useState<number>(1);

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It might help to have comments explaining the purposes these (where it makes sense)

e.g. what is the purpose of the graywashRef


// draws outline around rectangle in the same colour as the submit button
let strokeColor;
const sentryFeedback = DOCUMENT.getElementById('sentry-feedback');

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is sentry-feedback id always guaranteed to exist?

@c298leec298leeFeb 21, 2025

Copy link
Copy Markdown
ContributorAuthor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

It's the id attribute of the div that contains the feedback widget. Good catch tho, this can actually be customized

@ryan953
ryan953 changed the base branch from develop to ryan953/feedback-highlight-maskFebruary 24, 2025 23:22
@ryan953
ryan953 merged commit c9daae0 into ryan953/feedback-highlight-maskFeb 24, 2025
@ryan953
ryan953 deleted the cl/annotations-v2 branch February 24, 2025 23:23
ryan953 pushed a commit that referenced this pull request Feb 24, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
billyvg pushed a commit that referenced this pull request Feb 25, 2025
Allows you to edit screenshots with highlight and hide boxes, with the
ability to delete individual boxes and resize the page. This will
replace the previous cropping and pen annotation.
![image](https://github.com/user-attachments/assets/9cf9dbfa-b65b-47fc-8933-bafe33687eb8)
Related to getsentry/sentry#69786
ryan953 added a commit that referenced this pull request Apr 3, 2025
…shots (#15951)
| Editing | In Sentry |
| --- | --- |
| <img width="1408" alt="SCR-20250402-pfuj"
src="https://github.com/user-attachments/assets/896a1efe-74ac-42ca-8f51-b7024dee768c"
/> | <img width="1421" alt="SCR-20250402-pgft"
src="https://github.com/user-attachments/assets/37337f95-9e4d-477f-935b-2545466bc455"
/>
I should write that there are like 3 separate systems inside the
`ScreenshotEditor` component, all working with the same data and helpers
really, but each easy to spot and understand on their own.
The end-goal is to have the correct thing rendered into `outputBuffer`
(which is an argument to the component, but it's used for outputting
data) and also render into the `foreground` and `background`.
1. The first is the `useLayoutEffect` and `useEffect` calls. These
basically depend on the `screenshot` prop & `drawCommands` state. When
those change we're basically re-sizing and re-rendering into our
canvases.
2. The second system is all the stuff inside of `handleMouseDown`. We
call `getBoundingClientRect` and use offsetX/offsetY for a consistent
frame if reference when doing mouse coordinates. From in here we don't
update any react state until onMouseUp happens, so the re-rendering
onMouseMove is really fast to execute, and really easy to understand.
3. The last system to look at is is the `drawCommands` stuff and
`scaleFactor`. All the drawCommands in state/memory are using an x/y
coordinate system based on the size of the original screenshot. So when
we call paintForeground it's really easy. But when we want to add
`<div>` elements to the page we have to scale the sizes. This helps with
window resize, and helps to consolidate when/where we convert from one
x/y coordinate system to another.
The resulting feedbacks are in the correct dpi, and have boxes draw
using the same DPI.
| Case | Img |
| --- | --- |
| No boxes drawn ever | <img width="485" alt="SCR-20250402-jidz"
src="https://github.com/user-attachments/assets/3f5d177a-4652-40c1-be89-bfa2ff4f7399"
/> |
| Drew some, then removed them | <img width="452"
alt="SCR-20250402-jifp"
src="https://github.com/user-attachments/assets/c24fc144-d0f1-4b64-af6c-199eff0a3fee"
/> |
| Some boxes | <img width="452" alt="SCR-20250402-jigm"
src="https://github.com/user-attachments/assets/a3af82b1-16a8-4a78-bac4-5d83f687a59f"
/> |
Related to #15424
Iteration on top of
develop...ryan953/feedback-highlight-mask-refFixesgetsentry/sentry#69786
---------
Co-authored-by: Billy Vong <billyvg@users.noreply.github.com>
Sign up for freeto join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Epic] User Feedback Annotations

3 participants

@c298lee@billyvg@ryan953