Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

How can i migrant from kafka to rocketmq? #527

Open
pc-gh opened this issue Nov 15, 2023 · 1 comment
Open

How can i migrant from kafka to rocketmq? #527

pc-gh opened this issue Nov 15, 2023 · 1 comment

Comments

@pc-gh
Copy link

pc-gh commented Nov 15, 2023

There are my steps:

  • 1、run Worker

It can work normal,console show the message "The standalone worker boot success.".

  • 2、change the config file and restart Worker

i set plugin path value as your recommand

pluginPaths=/usr/local/connector-plugins
  • 3、add connect-kafka plugin

I try to package the module "rocketmq-connect-kafka",but i got a pom file.then i change pom.xml,let packaging labe value equal jar,then i got a jar file.And i push it to the plugin path.i also restarted Worker by the script "sh bin/connectshutdown.sh".

  • 4、create source connect-kafka

I create connect kafka by url like this:

http://127.0.0.1:8081/connectors/connector-name?config={"connector.class":"org.apache.rocketmq.connect.kafka.connector.KafkaSourceConnector","tasks.num":"1","kafka.topics":"test1,test2","kafka.group.id":"group0","kafka.bootstrap.server":"127.0.0.1:9092","source-record-converter":"org.apache.rocketmq.connect.runtime.converter.JsonConverter"}

however i got the response:

{
    "errorCode": 500,
    "message": "Failed to find any class that implements Connector and which name matches org.apache.rocketmq.connect.kafka.connector.KafkaSourceConnector, available connectors are: PluginWrapper{klass=class org.apache.rocketmq.connect.file.FileSinkConnector, name='org.apache.rocketmq.connect.file.FileSinkConnector', type=sink, typeName='sink', location='classpath', version='undefined', encodedVersion=undefined, classLoader=sun.misc.Launcher$ExtClassLoader@19469ea2}, PluginWrapper{klass=class org.apache.rocketmq.connect.file.FileSourceConnector, name='org.apache.rocketmq.connect.file.FileSourceConnector', type=source, typeName='source', location='classpath', version='undefined', encodedVersion=undefined, classLoader=sun.misc.Launcher$ExtClassLoader@19469ea2}"
}

Did i overlook something important?Hope your reply!

@pc-gh pc-gh changed the title how can i migrant kafka topic to rocketmq? How can i migrant from kafka to rocketmq? Nov 15, 2023
@zhongxig
Copy link

  1. Explain: "Failed to find": means "connector-plugins" didn't contains "org.apache.rocketmq.connect.kafka.connector.KafkaSourceConnector" plugin-jar.
  2. Cause: maybe "3、add connect-kafka plugin" has something error. let me see.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants