[SPARK-37050][PYTHON] Update Conda installation instructions

[h-vetinari]

What changes were proposed in this pull request?

Improve conda installation docs

Why are the changes needed?

As requested here. Ideally, this should be backported to the 3.2-branch (so it becomes visible for the 3.2.0 installation documentation here).
CC @gengliangwang

Does this PR introduce any user-facing change?

No

How was this patch tested?

Not tested

[gengliangwang]

@h-vetinari Thanks for the first contribution! Could you file a Jira ticket on https://issues.apache.org/jira/secure/RapidBoard.jspa?rapidView=256 and follow the PR template?

### What changes were proposed in this pull request?
### Why are the changes needed?
### Does this PR introduce _any_ user-facing change?
### How was this patch tested?

[gengliangwang]

cc @HyukjinKwon@ueshin@zero323@itholic

[HyukjinKwon]

ok to test

[HyukjinKwon]

@srowen, when you find some time, can you help reviewing this please 🙏

[HyukjinKwon]

Looks pretty good otherwise - made some minor suggestions. Thanks for your PR @h-vetinari.

[HyukjinKwon]

Jenkins, ok to test

[SparkQA]

Test build #144481 has finished for PR 34315 at commit 45dc138.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48953/

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48953/

[HyukjinKwon]

will merge this one in few more days if there are no more comments.

[h-vetinari]

will merge this one in few more days if there are no more comments.

Sounds good, thanks for the review!

Are you planning to merge to the 3.2 branch as well? I think that would be worth a consideration given that the online docs would otherwise keep reflecting the old instructions until 3.3, which is going to take a while yet...

[SparkQA]

Test build #144486 has finished for PR 34315 at commit e7b891f.

• This patch passes all tests.
• This patch merges cleanly.
• This patch adds no public classes.

[HyukjinKwon]

I think we can backport to branch-3.2 but that won't be available on Spark 3.2.0 as it's already released. So i will probably just merge it to master branch for now.

[SparkQA]

Kubernetes integration test starting
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48958/

[h-vetinari]

I think we can backport to branch-3.2 but that won't be available on Spark 3.2.0 as it's already released.

Well, 3.2.1 will presumably still arrive much sooner than 3.3.0, and then the most current docs would also be updated along with it, no?

[HyukjinKwon]

Might be faster a couple of months, and improvement doesn't usually go to maintenance release by right.

[srowen]

A docs change like this seems ok to backport to 3.2 imho

[SparkQA]

Kubernetes integration test status failure
URL: https://amplab.cs.berkeley.edu/jenkins/job/SparkPullRequestBuilder-K8s/48958/

[HyukjinKwon]

Just wanted to more just point out the standard practice. I am good with that too for extra clarification.

[h-vetinari]

Thanks both, glad to hear it! :)

[gengliangwang]

Thanks for the update. +1 to backport to the 3.2 documentation site.

[HyukjinKwon]

Merged to master and branch-3.2.