运行一段时间后，突然报错 failed to acquite target io.Writer: try create new files too many times

[CxistHans]

Bug Description
之前安装一路正常，两天后突然报错：

write log error: failed to acquite target io.Writer: try create new files too many times
Failed to fire hook: failed to acquite target io.Writer: try create new files too many times
12/13 03:31:00.005927 00000035 MON ERROR upload_id:0x2000000000095200, upload to keeper error, err:Post "http://127.0.0.1:6043/adapter_report": dial tcp 127.0.0.1:6043: connect: connection refused
12/13 03:31:15.004949 00000035 MON ERROR upload_id:0x2000000000095300, upload to keeper error, err:Post "http://127.0.0.1:6043/adapter_report": dial tcp 127.0.0.1:6043: connect: connection refused
12/13 03:31:30.005815 00000035 MON ERROR upload_id:0x2000000000095400, upload to keeper error, err:Post "http://127.0.0.1:6043/adapter_report": dial tcp 127.0.0.1:6043: connect: connection refused
12/13 03:31:45.006813 00000035 MON ERROR upload_id:0x2000000000095500, upload to keeper error, err:Post "http://127.0.0.1:6043/adapter_report": dial tcp 127.0.0.1:6043: connect: connection refused
12/13 03:32:00.006544 00000035 MON ERROR upload_id:0x2000000000095600, upload to keeper error, err:Post "http://127.0.0.1:6043/adapter_report": dial tcp 127.0.0.1:6043: connect: connection refused
12/13 03:32:15.006891 00000035 MON ERROR upload_id:0x2000000000095700, upload to keeper error, err:Post "http://127.0.0.1:6043/adapter_report": dial tcp 127.0.0.1:6043: connect: connection refused

To Reproduce
用dbeaver 连接测试正常，打开表就超时，然后看到报错

Screenshots

Environment (please complete the following information):

• OS: k8s节点应该跟报错无关
• 资源够用
• TDengine Version [docker : 3.3.4.8]

Additional Context
k8s 部署的，yml:

kind: StatefulSet
metadata:
  name: tdengine
  namespace: tdengine
spec:
  selector:
    matchLabels:
      app: tdengine
  serviceName: tdengine
  template:
    metadata:
     labels:
       app: tdengine
    spec:
      nodeSelector:
        servicetype: base
      containers:
      - name: tdengine
        image: tdengine:3.3.4.8
        ports:
        - containerPort: 6041
          name: interface
        - containerPort: 6030
          name: taosc
        - containerPort: 6060
          name: explorer
        volumeMounts:
          - name: storage-data
            mountPath: var/lib/taos
          - name: storage-log
            mountPath: /var/log/taos
          - name: tz-config
            mountPath: /etc/localtime
        env:
        - name: TZ
          value: "Asia/Shanghai"
      volumes:
        - name: tz-config
          hostPath:
            path: /usr/share/zoneinfo/Asia/Shanghai
        - name: storage-data
          persistentVolumeClaim:
            claimName: tdengine-data
        - name: storage-log
          persistentVolumeClaim:
            claimName: tdengine-log

nfs 目录:

上面还有很多的lock结尾的文件

猜测: 是生成的log权限问题？

[CxistHans]

因为都是0kb，我尝试删除
find tdengine-log/ -name "taoskeeper*" -delete
然后发现：

taosadapter 的日志一样的。
重启服务log文件又重新生成了

12/13 12:49:00.006526 00000471 WEB INFO  QID:0x2000000000001500 finish request, status_code:200, latency:4.194927ms, client_ip:127.0.0.1, method:POST, uri:/adapter_report
[GIN] 2024/12/13 - 12:49:00 | 200 |    4.442269ms |       127.0.0.1 | POST     "/adapter_report"
write log error: failed to acquite target io.Writer: try create new files too many times
12/13 12:49:08.078322 00000129 C UTL report client cont with QID:0x100000000022700
12/13 12:49:08.082023 00000035 WEB INFO  QID:0x2000000000000014 finish request, status_code:204, latency:2.481431ms, client_ip:127.0.0.1, method:POST, uri:%2Finfluxdb%2Fv1%2Fwrite%3Fdb%3Dlog%26precision%3Dms%26qid%3D72057594038068992%26table_name_key%3Dpriv_stn
12/13 12:49:08.082291 00000471 WEB INFO  QID:0x100000000022700 finish request, status_code:200, latency:3.424121ms, client_ip:127.0.0.1, method:POST, uri:/general-metric
[GIN] 2024/12/13 - 12:49:08 | 200 |    3.529521ms |       127.0.0.1 | POST     "/general-metric"
write log error: failed to acquite target io.Writer: try create new files too many times
12/13 12:49:13.598389 00000035 WEB INFO  QID:0x100000000022e00 finish request, status_code:200, latency:2.235836ms, client_ip:127.0.0.1, method:POST, uri:%2Frest%2Fsql%2Flog%3Freq_id%3D72057594038070784