Does vector support automatic deletion of files after reading?

[PanHywel]

I am writing logs to a file by hour via Nginx lua, and then reading the file via vector to write the contents to kafka, but when the reading is done, the file needs to be deleted manually, which bothers me a lot.
Does vector support automatic deletion of individual files after they are read?

[sources.nginx_file_sources]
  type = "file"
  include = ["/openresty/nginx/conf/waf/log/*.log"]
  data_dir = "/vector"

[jszwedko]

Hi @PanHywel !

You can configure remove_after_secs on the file source to have it remove files after they have been processed if they haven't received writes in the specified number of seconds.

[PanHywel]

Thank you very much.