ARROW-12744: [C++][Compute] Add rounding kernel

[edponce]

This PR adds rounding compute functions, namely "round" and "round_to_multiple".

• round(x, RoundOptions(ndigits, round_mode)) - round x to the precision indicated by ndigits
• round_to_multiple(x, RoundToMultipleOptions(multiple, round_mode)) - round x to scale of multiple

Rounding modes supported are: DOWN, UP, TOWARDS_ZERO, TOWARDS_INFINITY, HALF_DOWN, HALF_UP, HALF_TOWARDS_ZERO, HALF_TOWARDS_INFINITY, HALF_TO_EVEN, HALF_TO_ODD.
By default tie-breaking modes round to the nearest integer and resolve ties with HALF_TO_EVEN.

The rounding functions expect floating-point inputs and return output of the same type. Integral inputs are implicitly type-casted and output is float64.

[github-actions]

https://issues.apache.org/jira/browse/ARROW-12744

[edponce]

@bkietz@jorisvandenbossche Need feedback on this PR. Specifically, the rounding options provided and kernel implementations.

[edponce]

There are 2 round functions (Round and MRound) and both use different Options but make use of the same enum RoundMode, therefore I defined enum RoundMode in global space of api_scalar.h. Based on the recent FunctionOptions changes, I added EnumTraits<RoundMode> to api_scalar.cc along with necessary type and registration code.

For tests, I wanted to use the values() method of EnumTraits to be able to iterate through the enum values, but I am not sure on how to invoke the EnumTraits<RoundMode> since it is not exposed in a header file. My solution was to create an array (kRoundModes) with the enum values in the global space of tests.

Also, I could not find a way to create the generator dispatchers without explicitly using the enum RoundMode values as template parameters (I do not think we can do this in C++11 because the value depends on the ty loop variable).

@lidavidm@bkietz Any comments or suggestions would be gladly appreciated.

[lidavidm]

There seem to be some Windows-specific test failures :/

[lidavidm]

Thanks, this looks good to me. I left two small comments.

[lidavidm]

Thanks, this LGTM.

[pitrou]

Should you undraft it or is it still WIP?

[edponce]

It is basically complete and undrafted. There are a few minor comments I made w.r.t. to doubts that I have.

[pitrou]

Nice! A bunch of comments below.

[edponce]

Ready for review cc @pitrou

[rok]

Looks great!
Would we consider pandas-like time unit rounding once we have this in?

[edponce]

@rok It is a possibility, if we have the semantics pinned down w.r.t. how to shift specific timestamps (forward, backward, delta). This would be a new set of compute functions: "round_time" and "round_time_to_multiple", where the latter could be a quaternary/varargs function to support multiples for hour, min, sec, ms/ns.

[rok]

@rok It is a possibility, if we have the semantics pinned down w.r.t. how to shift specific timestamps (forward, backward, delta).

Indeed that would probably need some work.

Does this currently support arbitrary rounding to multiple on timestamps? If yes it might be good to limit it to timezoneless and UTC timestamps to avoid ambiguous and nonexistent timestamp issues.

[lidavidm]

Looks fine to me. One minor comment.

[lidavidm]

Should this just return OptionsWrapper::Init like below?

[edponce]

No, it is RoundOptionsWrapper so that its constructor is invoked via make_unique, which initializes pow10 data member. If we use OptionsWrapper then pow10 is not available. I tried invoking OptionsWrapper::Init but it returns a std::unique_ptr which would require "casting" to RoundOptionsWrapper first and then to KernelState to match return type. The unique_ptr casting caused too many issues so I reverted to mimic the OptionsWrapper::Init method.

[edponce]

The way I used these OptionsWrapper classes:

• considers Init for options validation because Init can return a Status::Invalid
• constructor for initializing non-options state, which can then be accessed in kernels' Call via ctx->state()

[edponce]

I templetized Init method of KernelState derived classes so that derived constructors can be invoked without the need to duplicate the Init definition. This makes KernelState be fully functional to support options validation and extending kernel state via constructor which can most likely benefit other scalar kernels as well.

For example by extending, OptionsWrapper as follows:

template <typename OptionsType>
structOptionsWrapper : publicKernelState {
template <typename KernelStateType = OptionsWrapper>
static Result<std::unique_ptr<KernelState>> Init(KernelContext* ctx, const KernelInitArgs& args) {
if (auto options = static_cast<const OptionsType*>(args.options)) {
return ::arrow::internal::make_unique<KernelStateType>(*options);
}
...
}
...
};

now we can extend custom states as follows:

structRoundOptionsWrapper<RoundOptions> : public OptionsWrapper<RoundOptions> {
using OptionsType = RoundOptions;
using State = RoundOptionsWrapper<OptionsType>;
double pow10;
explicitRoundOptionsWrapper(OptionsType options) : OptionsWrapper(std::move(options)) {
pow10 = RoundUtil::Pow10(std::abs(options.ndigits));
}
static Result<std::unique_ptr<KernelState>> Init(KernelContext* ctx, const KernelInitArgs& args) {
return OptionsWrapper<OptionsType>::Init<State>(ctx, args);
}
};

[edponce]

Ok, I tried the template variant of OptionsWrapper and although it made the code cleaner, it failed to compiled for some systems, so reverted to duplicating the OptionsWrapper::Init definition. I think there needs to be a refactoring of KernelState and related parts to support validating kernel options and extending kernel state in a simpler manner. There are different patterns being used in the code to fulfill these. But this is a separate issue from this PR.

[pitrou]

Just for the record, it feels a bit weird to call GenerateArithmeticRound at kernel execution time. That said, a quick benchmarking in Python shows there doesn't seem to be any large overhead:

>>>importpyarrowaspa, pyarrow.computeaspc>>>floor=pc.get_function("floor")
>>>round=pc.get_function("round")
>>>arr=pa.array([None], type=pa.float64())
>>>%timeitfloor.call([arr])
2.57µs ± 10.2nsperloop (mean ± std. dev. of7runs, 100000loopseach)
>>>%timeitfloor.call([arr])
2.58µs ± 11.3nsperloop (mean ± std. dev. of7runs, 100000loopseach)
>>>%timeitround.call([arr])
2.65µs ± 10.6nsperloop (mean ± std. dev. of7runs, 100000loopseach)
>>>%timeitround.call([arr])
2.53µs ± 12.5nsperloop (mean ± std. dev. of7runs, 100000loopseach)

[edponce]

I agree. The purpose of doing this here is to generate dispatchers once prior to kernel invocation. Previously, I tried 2 solutions:

• Have a vector of precompute GenerateArithmeticFloatingPoint and use the options.round_mode to index this vector. But this required vector to be ordered identically to the round modes in enum RoundMode.
• Similar to above but using an unordered_map indexed by options.round_mode. This requires adding hash support for RoundMode data type. This approach does not imposes a full constraint on the ordering of RoundMode.

Which one do you think is best?

[edponce]

Actually, it is doing the same thing as the other kernels. Other kernels pass exec (an ArrayKernelExec) to the AddKernel method without invoking it. exec is invoked during kernel dispatching because it requires KernelContext, ExecBatch, and Datum parameters.

[edponce]

@rok This PR only supports rounding for basic arithmetic data types (unsigned/signed int and floating-point).

[lidavidm]

@edponce looks like you need to rebase again here as well.

[edponce]

This PR is ready for a (hopefully) final review. cc @lidavidm@pitrou

[edponce]

Are there any additional comments/reviews? cc @pitrou@bkietz@jorisvandenbossche

[pitrou]

Thanks for the update! I'll push a few minor changes and will merge.