Debug on OSX is not working when running traffic_manger

[bryancall]

11:26:53 C02XF1ULJG5J:(master)~/dev/apache/trafficserver$ sudo /usr/local/bin/traffic_manager
[E. Mgmt] log ==> [TrafficManager] using root directory '/usr/local'
[TrafficManager] ==> Cleaning up and reissuing signal #11
Fatal: pthread_mutex_lock(0x7f92d8c07798) failed: Resource deadlock avoided (11)
[TrafficManager] ==> Cleaning up and reissuing signal #11
Fatal: pthread_mutex_lock(0x7f92d8c07798) failed: Resource deadlock avoided (11)
[TrafficManager] ==> Cleaning up and reissuing signal #11
Fatal: pthread_mutex_lock(0x7f92d8c07798) failed: Resource deadlock avoided (11)
[TrafficManager] ==> Cleaning up and reissuing signal #11
Fatal: pthread_mutex_lock(0x7f92d8c07798) failed: Resource deadlock avoided (11)
^C[TrafficManager] ==> Cleaning up and reissuing signal #2

[bryancall]

The test I am using on git bisect:

#!/bin/bash

# turn on bash debug
set -x

# stop ATS
sudo /usr/local/bin/trafficserver stop
sudo pkill -9 traffic_manager
sudo pkill -9 traffic_server

# clean up
cd ~/dev/apache/trafficserver
git clean -xfd
git checkout -- .
sudo rm -rf /usr/local/etc/trafficserver /usr/local/var/trafficserver /usr/local/var/log/trafficserver /usr/local/lib/libts* /usr/local/lib64/libts*

# build
autoreconf -if
./configure --enable-ccache
make -j 8
if [ $? -ne 0 ]; then exit 125; fi
sudo make install -j
if [ $? -ne 0 ]; then exit 125; fi

# test ATS
#sudo /usr/local/bin/trafficserver stop
#sudo /usr/local/bin/trafficserver start
#if [ $? -ne 0 ]; then exit 125; fi

# configuration change
sudo sed -i bak 's/CONFIG proxy.config.diags.debug.enabled INT 0/CONFIG proxy.config.diags.debug.enabled INT 1/' /usr/local/etc/trafficserver/records.config
sudo sed -i bak 's/CONFIG proxy.config.diags.debug.tags STRING http|dns/CONFIG proxy.config.diags.debug.tags STRING log-file/' /usr/local/etc/trafficserver/records.config

# test ATS
sudo /usr/local/bin/trafficserver stop
sudo pkill -9 traffic_manager
sudo pkill -9 traffic_server
sudo /usr/local/bin/trafficserver start
if [ $? -ne 0 ]; then exit 125; fi

sleep 30

# run regression test
if [ $(grep 'Relaunching proxy after' /usr/local/var/log/trafficserver/manager.log | wc -l) -gt 1 ]; then
  sudo /usr/local/bin/trafficserver stop
  sudo pkill -9 traffic_manager
  sudo pkill -9 traffic_server
  exit 1
fi

sudo /usr/local/bin/trafficserver stop
sudo pkill -9 traffic_manager
sudo pkill -9 traffic_server
exit 0

[bryancall]

Looks like the problem is in Diags::tag_activated

[github-actions]

This issue has been automatically marked as stale because it has not had recent activity. Marking it stale to flag it for further consideration by the community.

[bryancall]

The crash reported here is a deadlock (pthread_mutex_lock returning Resource deadlock avoided) that happens specifically when launching the traffic_manager process on macOS with debug enabled, bisected to Diags::tag_activated. The traffic_manager process and its entire source directory were removed from Apache Traffic Server in #8633, which first shipped in release 10.0.0. Since the component that crashed no longer exists, this startup deadlock is no longer reachable. I am closing this as obsolete after the traffic_manager removal. If a similar deadlock in Diags::tag_activated is seen in a current process such as traffic_server, please open a new issue with a reproduction against a recent release.