{"full_name":"redpanda-data/connect","owner":"redpanda-data","name":"connect","shard":"1","url":"https://github.com/redpanda-data/connect","description":"Fancy stream processing made operationally mundane","homepage":"https://docs.redpanda.com/connect/home/","topics":["message-queue","stream-processing","streaming-data","message-bus","logs","stream-processor","cqrs","event-sourcing","go","golang","kafka","amqp","rabbitmq","nats","etl"],"tag_pages":["cqrs","etl","event-sourcing","go","golang","kafka","logs","message-queue","rabbitmq","stream-processing"],"language":"Go","license":null,"avatar":"https://avatars.githubusercontent.com/u/49406389?v=4","created_at":"2016-03-22T01:18:48Z","pushed_at":"2026-11-15T04:13:11Z","metrics":{"stars":8799,"forks":983,"watchers":111,"issues":1642,"prs":3308,"releases":562,"issues_open":202,"issues_closed":1440,"prs_open":205,"prs_closed":754,"prs_merged":2349,"discussions":209},"growth":{"day":{"stars":-1,"forks":0,"base_day":"2026-11-15"}},"history":{"dates":["2026-11-10","2026-11-11","2026-11-12","2026-11-13","2026-11-14","2026-11-15","2026-11-16"],"stars":[8797,8798,8798,8798,8800,8800,8799],"forks":[982,983,982,982,983,983,983],"watchers":[null,112,112,112,111,111,111],"issues_open":[null,200,200,200,201,201,202],"prs_open":[null,207,209,207,205,205,205]},"boards":{},"same_owner":[],"issues":[{"number":271,"title":"upgrade \"files\" input with watchdog","comments":13,"created_at":"2019-09-06T10:58:53Z"},{"number":2522,"title":"GCP cloud storage output error with Failed to delete temporary file used for merging: context canceled","comments":11,"created_at":"2024-04-16T11:37:01Z"},{"number":1677,"title":"`sql_raw` output should support batched/transactional sends when possible","comments":9,"created_at":"2023-01-16T08:47:26Z"},{"number":978,"title":"Investigate elastic/opensearch forks","comments":8,"created_at":"2021-11-29T12:40:13Z"},{"number":4648,"title":"redpanda (kafka (eventhubs)) input stalling for exactly 15 minutes","comments":8,"created_at":"2026-07-31T08:39:12Z"},{"number":4387,"title":"Redpanda output with idempotent_writes makes unordered results","comments":7,"created_at":"2026-05-04T12:13:48Z"},{"number":1679,"title":"gcp_cloud_storage(input) lack of randomize Objects List","comments":7,"created_at":"2023-01-16T23:07:16Z"},{"number":1581,"title":"Implement `event_window` buffer","comments":7,"created_at":"2022-11-21T09:53:34Z"}],"discussions":[{"number":5051,"title":"Does the HDFS output support writing to Erasure-Coded (EC) directories?","comments":1,"category":"Q&A","created_at":"2026-10-26T13:17:53Z"},{"number":4622,"title":"Http_Client stream.enabled=true disable/removal doesn't reliably terminate streaming","comments":0,"category":"General","created_at":"2026-07-22T22:35:58Z"},{"number":4552,"title":"opensearch output: action does not support \"create\"","comments":0,"category":"General","created_at":"2026-06-24T09:01:45Z"},{"number":4442,"title":"Multiple outputs with different formats (VictoriaMetrics + PostgreSQL)","comments":0,"category":"General","created_at":"2026-05-20T02:18:40Z"},{"number":4425,"title":"How to build redpanda connect and include my custom processor","comments":1,"category":"Q&A","created_at":"2026-05-13T16:34:51Z"},{"number":4264,"title":"Logging to stdout and file","comments":0,"category":"Q&A","created_at":"2026-04-16T09:56:01Z"},{"number":4259,"title":"delete before insert with sql_raw","comments":0,"category":"Q&A","created_at":"2026-04-15T11:25:14Z"},{"number":4213,"title":"Why does AMQP_1 not preserve properties like message-id?","comments":2,"category":"General","created_at":"2026-04-03T19:29:19Z"}],"latest_release":{"name":"v4.118.0","tag":"v4.118.0","published_at":"2026-11-13T01:27:10Z","body":"For installation instructions check out the [getting started guide](https://docs.redpanda.com/connect/guides/getting_started).\n\n### Added\n\n- azure: Azure Blob Storage output now supports blob index tags for organizing and filtering blobs, with configuration-time validation and best-effort tag application for pre-existing append blobs. ([@cadiidii](https://github.com/cadiidii), [#4204](https://github.com/redpanda-data/connect/pull/4204))\n- telemetry: Pipeline ID from the control plane is now included in the anonymous telemetry payload for correlation with usage and billing data. ([@prakhargarg105](https://github.com/prakhargarg105), [#4758](https://github.com/redpanda-data/connect/pull/4758))\n\n### Fixed\n\n- dynamodb: DynamoDB CDC input now correctly deduplicates snapshots and CDC events across different time zones and within the same second. ([@Leward](https://github.com/Leward), [#5057](https://github.com/redpanda-data/connect/pull/5057))\n- dynamodb: AWS DynamoDB CDC input now properly resumes snapshots with the correct segment count. ([@squiidz](https://github.com/squiidz), [#5181](https://github.com/redpanda-data/connect/pull/5181))\n- dynamodb: AWS DynamoDB CDC input now retries table coordinator shard refresh on failure instead of giving up. ([@squiidz](https://github.com/squiidz), [#5182](https://github.com/redpanda-data/connect/pull/5182))\n- influxdb: InfluxDB metrics exporter now properly stops its flush loop on close, preventing goroutine leaks and duplicate metric writes. ([@Leward](https://github.com/Leward), [#5130](https://github.com/redpanda-data/connect/pull/5130))\n- kafka: Sarama Kafka output now supports idempotent writes by properly configuring RequiredAcks and MaxOpenRequests when idempotent_write is enabled. ([@Leward](https://github.com/Leward), [#5167](https://github.com/redpanda-data/connect/pull/5167))\n- mongodb: MongoDB CDC input now ensures the incremental snapshot waits for the majority snapshot to reach the stream start, preventing data loss from concurrent writes. ([@Leward](https://github.com/Leward), [#5132](https://github.com/redpanda-data/connect/pull/5132))\n- postgres: PostgreSQL CDC input now prevents parallel snapshot chunks from moving each other's bounds during processing. ([@josephwoodward](https://github.com/josephwoodward), [#5204](https://github.com/redpanda-data/connect/pull/5204))\n- sftp: SFTP input now correctly counts minimum_age from whole-second modification times, preventing premature reads of files with incomplete data. ([@Leward](https://github.com/Leward), [#5125](https://github.com/redpanda-data/connect/pull/5125))\n\n### Changed\n\n- oracledb: Oracle CDC input now uses partitioned table snapshots for improved performance and reliability when capturing changes from large tables. ([@josephwoodward](https://github.com/josephwoodward), [#5006](https://github.com/redpanda-data/connect/pull/5006))\n- otel: Update to OTEL package to address CVE includes breaking change (see [here](https://github.com/open-telemetry/opentelemetry-go/pull/8490)) - use `go.opentelemetry.io/otel/attribute.Value` and `go.opentelemetry.io/otel/attribute.KeyValue` for log bodies and attributes in `go.opentelemetry.io/otel/log`, `go.opentelemetry.io/otel/log/logtest`, `go.opentelemetry.io/otel/sdk/log`, and `go.opentelemetry.io/otel/sdk/log/logtest`. ([@josephwoodward](https://github.com/josephwoodward), [#5207](https://github.com/redpanda-data/connect/pull/5207))\n\nThe full change log can be [found here](https://github.com/redpanda-data/connect/blob/main/CHANGELOG.md).\n\n\n","is_prerelease":false},"readme":true,"readme_zh":false,"news":[],"stale":false,"snapshot_at":"2026-11-16T09:23:14Z","history_start":"2026-09-06"}