Skip to content
forked from aohan237/asyncnsq

asyncio (PEP 3156) nsq (message queue) client.

Notifications You must be signed in to change notification settings

khvn26/asyncnsq

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

asyncnsq

async nsq with python3.6 await/async supported

if you dont like the pynsq(which use tornado) way to interact with nsq, then this library may be suitable for you

you can use this library as the common way to write things

Latest Updates

  • support dpub
  • support lookupd_http

Install

pip install asyncnsq

Usage examples

All you need is a loop, then enjoy

Consumer:

loop = asyncio.get_event_loop()

async def go():
    try:
        nsq_consumer = await create_nsq_consumer(
            lookupd_http_addresses=[
                ('127.0.0.1', 4161)],
            max_in_flight=200)
        await nsq_consumer.subscribe('test_async_nsq', 'nsq')
        for waiter in nsq_consumer.wait_messages():
            message = await waiter
            print(message.body)
            await message.fin()
        nsq_consumer = await create_nsq_consumer(
            host=['tcp://127.0.0.1:4150'],
            max_in_flight=200)
        await nsq_consumer.subscribe('test_async_nsq', 'nsq')
        for waiter in nsq_consumer.wait_messages():
            message = await waiter
            print(message.body)
            await message.fin()
    except Exception as tmp:
        logger.exception(tmp)

loop.run_until_complete(go())

Producer:

loop = asyncio.get_event_loop()

async def go():
    nsq_producer = await create_nsq_producer(host='127.0.0.1', port=4150,
                                             heartbeat_interval=30000,
                                             feature_negotiation=True,
                                             tls_v1=True,
                                             snappy=False,
                                             deflate=False,
                                             deflate_level=0,
                                             loop=loop)
    for i in range(10):
        await nsq_producer.pub('test_async_nsq', 'test_async_nsq:{i}'.format(i=i))
        await nsq_producer.dpub('test_async_nsq', i * 1000,
                                'test_delay_async_nsq:{i}'.format(i=i))
loop.run_until_complete(go())

Requirements

  • Python_ 3.5+ https://www.python.org

  • nsq_ http://nsq.io

  • python-snappy

    1. ubuntu:
      • sudo apt-get install libsnappy-dev
      • pip install python-snappy
    2. centos:
      • sudo yum install snappy-devel
      • pip install python-snappy
    3. mac:
      • brew install snappy # snappy library from Google
      • CPPFLAGS="-I/usr/local/include -L/usr/local/lib" pip install python-snappy

License

The asyncnsq is offered under MIT license.

About

asyncio (PEP 3156) nsq (message queue) client.

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages

  • Python 99.2%
  • Makefile 0.8%