Hello,
I've been trying to use the template called "pub/sub to ElasticSearch" for dataflow. Except for some unexploitable logs when something went wrong with ElasticSearch insert it worked fine.
This weekend the dataflow stopped working tho. At first I couldn't see any error. After some investigation I realize I had a lot of INFO log that said "Log rotation: Error sending kill signal to docker container: Multiple containers named harness found".
My dataflow job is configured :
- Runner V2 is enable
- Streaming is enable
- MaxWorker 2
- Worker runs on "n1-standard-2"
I've stoped the dataflow job and re-create exactly the same one and it worked.
I'm a bit confused about the origin of those logs. The dataflow job couldn't process any message.
I couldn't find anything about this issue online.
Anyone have an idea ?