Skip to content

NotImplementedError: unable to open file: libtensorflow_io.so #2139

Description

@suyttthideptrai

I got NotImplementedError when calling tfio.audio.resample(wav, rate_in=sample_rate, rate_out=16000)

Based on TensorFlow Version Compatibility table at https://github.com/tensorflow/io/README.md, I have configured tensorflow packages as follow
$ conda list tensorflow

# packages in environment at /opt/conda/envs/sra-env:
#
# Name Version Build Channel
tensorflow 2.16.2 cpu_py312h69ecde4_0 conda-forge
tensorflow-base 2.16.2 cpu_py312h5c1443c_0 conda-forge
tensorflow-estimator 2.16.2 cpu_py312hbf2973a_0 conda-forge
tensorflow-hub 0.16.1 pyhd8ed1ab_3 conda-forge
tensorflow-io 0.37.1 pypi_0 pypi
tensorflow-io-gcs-filesystem 0.37.1 pypi_0 pypi

Python version:
$ conda list python

# packages in environment at /opt/conda/envs/sra-env:
#
# Name Version Build Channel
python 3.12.9 h9e4cc4f_1_cpython conda-forge
...

For the dev environment, I'm using this image: "mcr.microsoft.com/devcontainers/miniconda:1-3"

PRETTY_NAME="Debian GNU/Linux 12 (bookworm)"
NAME="Debian GNU/Linux"
VERSION_ID="12"
VERSION="12 (bookworm)"
VERSION_CODENAME=bookworm
ID=debian

Full stacktrace:

2025-03-24 07:14:42.426934: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: SSE4.1 SSE4.2 AVX AVX2 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
(640, 8)
WARNING:tensorflow:AutoGraph could not transform <function resample at 0x7f8a497571a0> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: unable to open file: libtensorflow_io.so, from paths: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
caused by: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so: undefined symbol: _ZNK10tensorflow4data11DatasetBase8FinalizeEPNS_15OpKernelContextESt8functionIFN4absl12lts_202308028StatusOrIN3tsl4core11RefCountPtrIS1_EEEEvEE']
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert
WARNING | AutoGraph could not transform <function resample at 0x7f8a497571a0> and will run it as-is.
Please report this to the TensorFlow team. When filing the bug, set the verbosity to 10 (on Linux, `export AUTOGRAPH_VERBOSITY=10`) and attach the full output.
Cause: unable to open file: libtensorflow_io.so, from paths: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
caused by: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so: undefined symbol: _ZNK10tensorflow4data11DatasetBase8FinalizeEPNS_15OpKernelContextESt8functionIFN4absl12lts_202308028StatusOrIN3tsl4core11RefCountPtrIS1_EEEEvEE']
To silence this warning, decorate the function with @tf.autograph.experimental.do_not_convert
Traceback (most recent call last):
File "/workspaces/sound-recognition-ai/python/test.py", line 9, in <module>
ds_ts = to_tensor_dataset(df)
^^^^^^^^^^^^^^^^^^^^^
File "/workspaces/sound-recognition-ai/python/utils/dframe_utils.py", line 74, in to_tensor_dataset
return ts_ds.map(transform_wav)
^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/dataset_ops.py", line 2299, in map
return map_op._map_v2(
^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/map_op.py", line 37, in _map_v2
return _MapDataset(
^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/map_op.py", line 107, in __init__
self._map_func = structured_function.StructuredFunctionWrapper(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/structured_function.py", line 265, in __init__
self._function = fn_factory()
^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 1251, in get_concrete_function
concrete = self._get_concrete_function_garbage_collected(*args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 1221, in _get_concrete_function_garbage_collected
self._initialize(args, kwargs, add_initializers_to=initializers)
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 696, in _initialize
self._concrete_variable_creation_fn = tracing_compilation.trace_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/tracing_compilation.py", line 178, in trace_function
concrete_function = _maybe_define_function(
^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/tracing_compilation.py", line 283, in _maybe_define_function
concrete_function = _create_concrete_function(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/tracing_compilation.py", line 310, in _create_concrete_function
traced_func_graph = func_graph_module.func_graph_from_py_func(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/framework/func_graph.py", line 1059, in func_graph_from_py_func
func_outputs = python_func(*func_args, **func_kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/eager/polymorphic_function/polymorphic_function.py", line 599, in wrapped_fn
out = weak_wrapped_fn().__wrapped__(*args, **kwds)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/structured_function.py", line 231, in wrapped_fn
ret = wrapper_helper(*args)
^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/data/ops/structured_function.py", line 161, in wrapper_helper
ret = autograph.tf_convert(self._func, ag_ctx)(*nested_args)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 693, in wrapper
raise e.ag_error_metadata.to_exception(e)
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 690, in wrapper
return converted_call(f, args, kwargs, options=options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 439, in converted_call
result = converted_f(*effective_args, **kwargs)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/tmp/__autograph_generated_filejvnwf2jf.py", line 13, in tf__transform_wav
retval_ = (ag__.converted_call(ag__.ld(load_wav_16k_mono), (ag__.ld(filename),), None, fscope), ag__.ld(class_id), ag__.ld(fold))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 377, in converted_call
return _call_unconverted(f, args, kwargs, options)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/autograph/impl/api.py", line 460, in _call_unconverted
return f(*args)
^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow/python/util/traceback_utils.py", line 153, in error_handler
raise e.with_traceback(filtered_tb) from None
File "/tmp/__autograph_generated_filejidpphe2.py", line 15, in tf__load_wav_16k_mono
wav = ag__.converted_call(ag__.ld(tfio).audio.resample, (ag__.ld(wav),), dict(rate_in=ag__.ld(sample_rate), rate_out=16000), fscope)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 469, in resample
value = tf.vectorized_map(f, input)
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 465, in f
return core_ops.io_audio_resample(
^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 88, in __getattr__
return getattr(self._load(), attrb)
^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 84, in _load
self._mod = _load_library(self._library)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 69, in _load_library
raise NotImplementedError(
NotImplementedError: in user code:
File "/workspaces/sound-recognition-ai/python/utils/dframe_utils.py", line 67, in transform_wav *
return load_wav_16k_mono(filename), class_id, fold
File "/workspaces/sound-recognition-ai/python/utils/wav_utils.py", line 59, in load_wav_16k_mono *
wav = tfio.audio.resample(wav, rate_in=sample_rate, rate_out=16000)
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 469, in resample **
value = tf.vectorized_map(f, input)
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/audio_ops.py", line 465, in f
return core_ops.io_audio_resample(
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 88, in __getattr__
return getattr(self._load(), attrb)
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 84, in _load
self._mod = _load_library(self._library)
File "/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/__init__.py", line 69, in _load_library
raise NotImplementedError(
NotImplementedError: unable to open file: libtensorflow_io.so, from paths: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so']
caused by: ['/opt/conda/envs/sra-env/lib/python3.12/site-packages/tensorflow_io/python/ops/libtensorflow_io.so: undefined symbol: _ZNK10tensorflow4data11DatasetBase8FinalizeEPNS_15OpKernelContextESt8functionIFN4absl12lts_202308028StatusOrIN3tsl4core11RefCountPtrIS1_EEEEvEE']

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions